web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

No record found.

News and Announcements icon
Community site session details

Community site session details

Session Id :
Dynamics 365 Community / Forums / Microsoft Dynamics CRM (Archived) / Problems in Data Migra...
Microsoft Dynamics CRM (Archived)

Problems in Data Migration using KingswaySoft

(0) ShareShare
ReportReport
Posted on by SachinLade 120

Hello,

This is my third post on forum regarding MS CRM 2015 Online data migration. For my earlier 2 posts, I have not received a single reply.

We are using KingswaySoft for data migration from MS SQL Server to MS CRM 2015 Online. The issue which I am facing here is explained in below scenario.

Scenario 1: I ran a batch of 204155 records for migration using KingswaySoft. The tool showed all green, saying all records were successfully transferred. When I pulled the records from MS CRM to check for actual count, I found out that only 197470 records were transferred. 6685 records were missing.

Scenario 2: I ran the batch again with Upsert method in KingswaySoft, and found out that 203933 records were transferred. Here again 222 records were missing.

Scenario 3: We also tried using custom code and pushing records using executivemultiple  command. We tried to transferred 12,00,000 records and found that 6,00,000 records were duplicated.

Is there any problem with MS CRM Online webservice? Basically it does not commit all records which are fired at it and at times it creates duplicate records. That's very strange.

Can anybody help me out in understanding this?

Regards,

Sachin

6685

*This post is locked for comments

I have the same question (0)
  • Daniel Cai Profile Picture
    Daniel Cai 935 on at

    Hi, 

    This is very strange, but I am looking for more information in order to better understand the issue. 

    For scenario 1, what's the destination component's Action Type? 

    For scenario 2, if you are doing Upsert, this could happen when you have duplicates from your source system. 

    Thanks,

  • Arthur82 Profile Picture
    Arthur82 on at

    On top of Daniel's queries, do you perhaps have the "Remove Unresolved References" check box ticked? This means that if a text lookup doesn't match exactly then the row silently fails.

    And, obvious question, but what's the settings in the Error Handling tab?

    For the ExecuteMultiple request in scenario 3, are you running multiple batches concurrently? ExecuteMultiple only supports one concurrent connection per user account. I'd try confirming that matching criteria doesn't let duplicates slip through (does matching criteria need to be tightened?) and try executing a single Upsert (or Create) request instead.

    Finally, how are you pulling the records out again - using KingswaySoft again? In which case are there any filters or is it the whole entity?

  • SachinLade Profile Picture
    SachinLade 120 on at

    Hello Daniel,

    For scenario 1, the destination component's Action type is Upsert. We have purposely used this Action type in order to avoid duplicate record creation in MS Dynamics CRM Online.

    Please throw some Insight on this Scenario.

    Scenario 2: We did using upsert, since we reran the batch again and to avoid duplicates beign created, we used Upsert.

    Your help would be valuable.

    Regards,

    Sachin

  • SachinLade Profile Picture
    SachinLade 120 on at

    Hello,

    The checkbox for "Remove Unresolved References" is not checked. So if there is any failure then we should actually get that error redirected to a text file.

    Above all, when it runs the batch, it shows all green with no errors and when checked against MS CRM, it shows missing records. Thats supprising.

    Regards,

    Sachin

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Neeraj Kumar – Community Spotlight

We are honored to recognize Neeraj Kumar as our Community Spotlight honoree for…

Congratulations to the November Top 10 Community Leaders!

These are the community rock stars!

Leaderboard > 🔒一 Microsoft Dynamics CRM (Archived)

#1
SA-08121319-0 Profile Picture

SA-08121319-0 4

#1
Calum MacFarlane Profile Picture

Calum MacFarlane 4

#3
Alex Fun Wei Jie Profile Picture

Alex Fun Wei Jie 2

Last 30 days Overall leaderboard

Featured topics

Product updates

Dynamics 365 release plans