We are migrating data from a bespoke app to D365 CE and its a case management type of solution. Our toolset includes SSIS, KingsWay components. We read data from an Azure SQL database using SSIS and using KingsWay upsert into Dataverse. No transformations take place in KingsWay, only lookups for GUIDs generated in Dataverse - for example: Case GUID is needed for Related Case entity as a foreign key.
I am seeking help with two recurring issues.
Time outs - entities like Case Requests, Related Cases, Phone, Milestones - these can have >100K records and they timeout frequently, every time we reload them. Interestingly, subsequent delta/incremental jobs load them all successfully.
Example: One of the entities failed after running for 10+ hours - loaded 300K records out of 500K . We expect it will run for another 3-5 hours and load remaining records.
Can't load multiple entities that has foreign key GUIDs from same table - results in resource unavailable error message.
Scenario: Case GUID is a foreign key in Case Outcome and Milestone. If we execute both Case Outcome and Milestone entity at the same time, one of these entities will fail, perhaps after loading 100 or 200 records.
To me it sounds like a table/entity locking issue where Case entity is locked while its being read by SSIS package(s).
Is there something equivalent to SQL nolock table hint or any other solution so we can load multiple children's entities simultaneously?
Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.
Share
Report
All responses (
Answers (
108
