I have a custom solution where we had to process 1,000,000 Cases and the process involved making 10 updates to each case i.e. 10 fields within each Case were being updated.
The workload is handled by breaking data into datasets using fetchxml of batches of 50,000 max each in what we call "Rules". Each rule can process up to 5,000 records per hour and they execute once per hour. A total of 10 rules were ran around the same time (minutes apart) so roughly around 50,000 Cases were being processed per hour. We ran this in production but it resulted in system performance issues and Microsoft diagnosed the problem as a throttled SQL Query due to high CPU usage.
Is there a specific number or a guideline number for how many we could process i.e. is there a number/guideline where SQL query throttling can occur so that we can ensure we process less than this?
Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.
Share
Report
All responses (
Answers (
121
