web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

No record found.

Community site session details

Community site session details

Session Id :
Microsoft Dynamics CRM (Archived)

Data Load for Go Live

(0) ShareShare
ReportReport
Posted on by 80

We are in the middle of our implementation and planning for our go live date.  So far, we've only loaded subsets of our data for testing and configuration.  In our sandbox, I've started loading our entire data set as a trial and the performance is abysmal.  We're on CRM Online and using an integration tool provided by our integration partner to load the records.  Accounts (231k) took about 2.5 days to load.  Contacts (1.5million) looks like it is going to take about 22 days to load.  I'm getting load rates of 2,500-3,500/hour, depending on the day and time.

So, I'm in a bit of a pickle as we can't take a month to load our data (we still have to do opportunities as well as the other smaller entities and relationships)

I'm looking for suggestions on how to make this better.  We can take a 3-5 day load, but not much more.  One thought was to begin loading now (we're about 4 weeks away from our scheduled go live) and try and do updates after the initial load, but that presents other issues as work is continuing on the system.  I tried the new bulk data load, but that does not seem to be as capable as it could be.

Any thoughts?

Thanks

-Frank

*This post is locked for comments

I have the same question (0)
  • Suggested answer
    Rahul-Waghmare Profile Picture
    990 on at

    Hello Frank,

    Go for SSIS integration with CRM, this will be the best ETL jobs for loading data. You can also choose 3rd party adaptor for best & fast results.

    Regards,

    Rahul

  • Wayne Walton Profile Picture
    13,730 on at

    Microsoft has a closed beta for their LCS data loading services. Performance is way faster than what you're reporting.  Maybe reach out to MS and see if you can get in the preview program.

  • FrankF-WorldStrides Profile Picture
    80 on at

    Rahul,

    Can you use SSIS with CRM Online?  

    -Frank

  • FrankF-WorldStrides Profile Picture
    80 on at

    Thanks Wayne.  We're trying it, but there is an API missing from our sandbox instance that prevents it from connecting.  Trying it in our "production" instance now to see how it performs.

  • Wayne Walton Profile Picture
    13,730 on at

    Yes, you can use SSIS, but you need a connector like Kingswaysoft for CRM Online.  Works well, generally speaking.

  • Suggested answer
    Rahul-Waghmare Profile Picture
    990 on at

    Yes we can use SSIS with CRM online, please go through below link for Kingswaysoft Adaptor for CRM.

    www.kingswaysoft.com/.../help-manual

    Regards,

    Rahul

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Neeraj Kumar – Community Spotlight

We are honored to recognize Neeraj Kumar as our Community Spotlight honoree for…

Leaderboard > 🔒一 Microsoft Dynamics CRM (Archived)

#1
SA-08121319-0 Profile Picture

SA-08121319-0 4

#1
Calum MacFarlane Profile Picture

Calum MacFarlane 4

#3
Alex Fun Wei Jie Profile Picture

Alex Fun Wei Jie 2

Last 30 days Overall leaderboard

Featured topics

Product updates

Dynamics 365 release plans