Finance | Project Operations, Human Resources, ...

ODATA handling of more than 10000 records: nextLink?

(1) Share

Report

Posted on by Basti Aurand

244

Hello,

we are facing the /known ODATA problem/ when working with more than 10000 records. What is the best way to handle those issues?

I read something about a nextLink keyword in ODATA but found nothing or no example for D365FO. I know that you could work with $skip $top to get the records in smaller packages, but this is quite a bit more of work than nextLink.

Thanks for any hints.

Sebastian

I have the same question (0)

All responses (6)

Answers (0)

Suggested answer

Anthony Blake 2,963 Super User 2025 Season 2 on at

Like (0)

Report

Consider Data Lake or Synapse Link if you are going over 10,000 on OData queries.

OData.NextLink: https://community.dynamics.com/forums/thread/details/?threadid=02d3d0cb-33ef-4e25-bcc8-cbc9125e71a6

$Top + $Skip: https://community.dynamics.com/blogs/post/?postid=c22b0bcf-014d-402f-817e-5aed4f756be1#:~:text=Introduction%3A,10K%20records%20at%20a%20time.

Was this reply helpful? Yes No
Basti Aurand 244 on at

Like (0)

Report

Thanks for the repsonse.

In the "Odata.NextLink" post the logic is described but unfortunatly there is no link in the ODATA response if you reduce the size with $top:

How could you reduce the size of the response and get the "getNext-Link" in the JSON response?

Was this reply helpful? Yes No
Suggested answer

Anthony Blake 2,963 Super User 2025 Season 2 on at

Like (0)

Report

That's correct, if you reduce the size to 100 rows, there wont be a next page so no next link. You will get the link if the results go over 10k rows

Was this reply helpful? Yes No
Basti Aurand 244 on at

Like (0)

Report

Is there any chance to configure the size of the packages (e.g.: 5000 instead of 10000)

Was this reply helpful? Yes No
Suggested answer

AR-01121610-0 4,967 Moderator on at

Like (1)

Report

Hy,

as per MS recommdation ODATA is only recommended for small data volume and less frequent actions as it can negative impact D365FO landscape.

Instead I recommend to create use data package and execute the data project from external (Data management package REST API - Finance & Operations | Dynamics 365 | Microsoft Learn)

If is is just export the "Export to DataLake" (already depreciated) or Synapse Link are also good choices as mentioned by Anthony.

Hope this helps.

Was this reply helpful? Yes No
Suggested answer

Anthony Blake 2,963 Super User 2025 Season 2 on at

Like (0)

Report

@sebastian, no its at 10k, but you could use $top 5000 with $skip 5000

Was this reply helpful? Yes No