Skip to main content

Notifications

Announcements

No record found.

Microsoft Dynamics CRM (Archived)

Troubleshoot bulk insert

Posted on by 105

Hi,

We have a customized on prem CRM 2013 implementation.  I found this week that it took 3 hours (!) to insert around 200 contacts using SSIS+cozyroc, which by definition calls the web frontend.  My guess is that we've got a plugin with a problem, or perhaps a missing index in the database.  Is there a way to profile the entire insert-contact transaction and see where the culprit(s) are?

Thank you.

Regards,

Rich

*This post is locked for comments

  • rduz Profile Picture
    rduz 105 on at
    RE: Troubleshoot bulk insert

    Hi,

    Thanks for trying to help me, I appreciate it.  I think I’ve done the simple and obvious things - the data is in a staging table, and I’ve prepopulated the relevant guid values, including the contactid for the new rows.  What I am trying to get to is to narrow down the root cause.  Is a plugin running for a significant amount of time?  Is the database at fault because, for example, a missing index?  In order to answer those questions, it would be helpful to know how much time a particular operation, such as adding a contact, is being spent in each plugin.  If it’s not a plugin, then I wonder about database operations.  Currently, the insert rate is about one row per minute, which is frightfully bad.  The servers have enough RAM and disk, they are quite near each other on a gigabit network.  The servers don’t have much load on them.  I think the db server might get to 15% utilization during the test and the crm frontend runs between 5 and 10%.  

    I can certainly go into my test environment and deactivate a plugin, run a test, reactivate a plugin.  One by one.  Kind of inefficient way to troubleshoot.  Is that the best we have?

    Thank you.

    Regards,

    Rich

  • Nadeeja Bomiriya Profile Picture
    Nadeeja Bomiriya 6,804 on at
    RE: Troubleshoot bulk insert

    Hi rduz,

    When importing data, it is best to turn off all the plugins and workflows, if possible to improve the performance.  Also, it's best to setup a staging database to prepare the data with lookups prepopulated with relevant GUID values.  This will improve the performance significantly.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Tips for Writing Effective Suggested Answers

Best practices for providing successful forum answers ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,269 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,198 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans