Hello everyone,
I am working on integrating Azure Blob Storage with Microsoft Dynamics 365 Business Central to import file links from a folder within a container into a Business Central table.
Here’s my scenario:
- I have uploaded more than 243,000 files into a specific folder inside a container in Azure Blob Storage.
- I want to list all the files in the folder and import their links into a Business Central table.
- However, I can only list and process the first 5,000 files. It seems the
ListBlobs
operation is limited to this count.
- How can I retrieve all the files in the folder beyond the 5,000-file limit using AL code in Business Central?
- Is there a way to handle continuation tokens or implement pagination in AL to overcome this limitation?
- Are there any best practices for efficiently managing and retrieving a large number of files from Azure Blob Storage in this context?
ABSBlob.Initialize(StorageAccount, ContainerName, Authorization);
ABSBlob.ListBlobs(ABSContContainer, ABSOptionalParameter);
This works fine for folders with fewer than 5,000 files, but it doesn’t seem to handle larger datasets.
Any guidance or example code for handling large file sets or continuation tokens would be greatly appreciated.
Thank you!