Announcements
Hello,
I want your suggestions and the most appropriate approach to the technology that we should use to implement the following requirements:
We have around 2500 employees and we plan to build a payroll calculation process on PowerApps model-driven.
Per employee, it will take approximately 12 records to generate his full salary.
So in total 30-40K records will be created when the calculation is over. Not to forget the other GET API operations to check the setup tables etc.. (Huge number of API calls)
I would like to know which product we should extend to handle this process and I thought about the following:
Using Azure Functions or the Console App with Dataverse.
We want to choose wisely as the product should be very stable and we want to avoid any timeout or delay issues during the calculation process.
Your advice and explanation of why we should use it and the pros and cons would be greatly appreciated.
Thank you,
EBMRay
Hi,
Execute multiple request can be used for batching
learn.microsoft.com/.../execute-multiple-requests
You can increase default 2 mins timeout value in CrmServiceClient.
Please read below article
You can use paging in fetchXml and query expression to retrieve more than 5k records
learn.microsoft.com/.../page-large-result-sets-with-fetchxml
Hello Bipin Kumar ,
Thank you for your suggestion.
I will determine which option is best for us.
Can you provide some documentation regarding the best practices to handle timeout, CRUD operation with batches (pagination), and If I missed anything please feel free to provide it.
Awaiting your response.
Best regards,
EBMRay
Hello Guido Preite ,
Thank you for your input.
We need to test both products as we need to check which one is more performant. This is because we have a lot of API calls to read from dataverse to fetch the related information for the employee and the setup tables etc..
We tried to calculate one employee using an Azure function (not durable) and it took around 5 minutes to calculate his salary which is a LOT of time.
Hi,
You can use azure function with premium plan which has unlimited timeout period
The following table shows the default and maximum values (in minutes) for specific plans:
Plan Default Maximum
Consumption plan 5 10
Premium plan 30 Unlimited
Dedicated plan 30 Unlimited
You can also create console application and host it on azure web jobs which can run on schedule
that amount of data can be orchestrated with a durable azure function but is not an easy task.
easier way will be to create a console application
André Arnaud de Cal... 291,359 Super User 2024 Season 2
Martin Dráb 230,370 Most Valuable Professional
nmaenpaa 101,156