Skip to main content

Notifications

Announcements

No record found.

Community site session details

Community site session details

Session Id :
Microsoft Dynamics CRM (Archived)

Data Load for Go Live

(0) ShareShare
ReportReport
Posted on by 80

We are in the middle of our implementation and planning for our go live date.  So far, we've only loaded subsets of our data for testing and configuration.  In our sandbox, I've started loading our entire data set as a trial and the performance is abysmal.  We're on CRM Online and using an integration tool provided by our integration partner to load the records.  Accounts (231k) took about 2.5 days to load.  Contacts (1.5million) looks like it is going to take about 22 days to load.  I'm getting load rates of 2,500-3,500/hour, depending on the day and time.

So, I'm in a bit of a pickle as we can't take a month to load our data (we still have to do opportunities as well as the other smaller entities and relationships)

I'm looking for suggestions on how to make this better.  We can take a 3-5 day load, but not much more.  One thought was to begin loading now (we're about 4 weeks away from our scheduled go live) and try and do updates after the initial load, but that presents other issues as work is continuing on the system.  I tried the new bulk data load, but that does not seem to be as capable as it could be.

Any thoughts?

Thanks

-Frank

*This post is locked for comments

  • Suggested answer
    Rahul-Waghmare Profile Picture
    Rahul-Waghmare 990 on at
    RE: Data Load for Go Live

    Yes we can use SSIS with CRM online, please go through below link for Kingswaysoft Adaptor for CRM.

    www.kingswaysoft.com/.../help-manual

    Regards,

    Rahul

  • Wayne Walton Profile Picture
    Wayne Walton 13,728 on at
    RE: Data Load for Go Live

    Yes, you can use SSIS, but you need a connector like Kingswaysoft for CRM Online.  Works well, generally speaking.

  • RE: Data Load for Go Live

    Thanks Wayne.  We're trying it, but there is an API missing from our sandbox instance that prevents it from connecting.  Trying it in our "production" instance now to see how it performs.

  • RE: Data Load for Go Live

    Rahul,

    Can you use SSIS with CRM Online?  

    -Frank

  • Wayne Walton Profile Picture
    Wayne Walton 13,728 on at
    RE: Data Load for Go Live

    Microsoft has a closed beta for their LCS data loading services. Performance is way faster than what you're reporting.  Maybe reach out to MS and see if you can get in the preview program.

  • Suggested answer
    Rahul-Waghmare Profile Picture
    Rahul-Waghmare 990 on at
    RE: Data Load for Go Live

    Hello Frank,

    Go for SSIS integration with CRM, this will be the best ETL jobs for loading data. You can also choose 3rd party adaptor for best & fast results.

    Regards,

    Rahul

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Vahid Ghafarpour – Community Spotlight

We are excited to recognize Vahid Ghafarpour as our February 2025 Community…

Tip: Become a User Group leader!

Join the ranks of valued community UG leaders

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 292,494 Super User 2025 Season 1

#2
Martin Dráb Profile Picture

Martin Dráb 231,313 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans