Skip to main content

Notifications

Microsoft Dynamics CRM (Archived)

Huge Data Import CRM Online

Posted on by 2,585

Hello Folks,

Can you suggest me a way to import BULK Data(200,00 records) Excel into CRM Online?

The scenario would be every month BULK records would get imported into CRM , if the record already exists then it gets updated, if it does not exist then it is created.

 Note:  if the Record is in Excel and not in CRM, then the record in CRM should be disabled/deleted.

Provide any feasible approaches. :)

Thank You

*This post is locked for comments

  • Suggested answer
    Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: Huge Data Import CRM Online

    Hi Sreekanth, below is my response:

    1st week  i had imported 200000 records ,  2nd week the excel would have 210000(10,000 records added to the existing excel), wont this cause a duplication of records.

    [VS]-You can add duplicate detection in it so that it will not upload the duplicate data.

    what is the need to create temporary entity if we can import in the main entity itself.

    [VS]- Because you need to do an upsert based on conditions you will have to write a code. Upset does not work on classic CRM import.

    As I said before, the other option is to create a console app but you will have to place it on some machine with internet connection enabled. Also, you will have to schedule it to run on some specific time or on demand run. However, in my 1st solution you need an extra machine or scheduling or manual run.

  • omgcrm Profile Picture
    omgcrm 2,585 on at
    RE: Huge Data Import CRM Online

    Hi,

    Is there any better way other than console app ?

    I am thinking to Import Data using import wizard crm online. But the question how do we delete records in crm which are not there in Excel? I am thinking to create a plugin/workflow  which deletes/disables the records which are not modified in the last 1 hour or so.. async. Is this right?

  • Suggested answer
    M.Azwar Alam Profile Picture
    M.Azwar Alam on at
    RE: Huge Data Import CRM Online

    Hi,

    If you are writing console app then you can create log entity and add your errors and success in that log entity or you can use file logging as well

    Mark as verified, if it works for you

  • omgcrm Profile Picture
    omgcrm 2,585 on at
    RE: Huge Data Import CRM Online

    Hi @Muhammad Azwar Alam

    If i am using the Console Approach i wont have the CRM inbuilt import feature available such as reverting back if import is wrong, etc. But it is a good approach.

    Hi @vikas

    In you approach of creating an temporary entity, Imagine 1st week  i had imported 200000 records ,  2nd week the excel would have 210000(10,000 records added to the existing excel), wont this cause a duplication of records and moreover what is the need to create temporary entity if we can import in the main entity itself?

    Thank You

    Hi Thomas 

    Would there any other way we can run it outside of Visual studio? I do not want to use 3rd part paid softwares for this functionality. Is there way to sync data from excel to crm using azure ?

  • Suggested answer
    Thomas David Dayman Profile Picture
    Thomas David Dayman 11,323 on at
    RE: Huge Data Import CRM Online

    Hi Skreeanth,

    I would recommend that you could use SSIS in Visual Studio and using the KingswaySoft adapter:

    www.kingswaysoft.com/.../download

    Its free to use if you only want to run a one off import. But you would have to pay a licence if you want to run it automatically outside of Visual Studio.

    Let me know if you want more info.

  • Suggested answer
    Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: Huge Data Import CRM Online

    You will have to write code for the same. Here is one approach, create a temporary entity which will have all fields that are required for the import. Import all data in that temp entity. On create of the temp entity record, run a workflow which validates the data and takes appropriate action. You can also use a console application but you will have to place it on a system.

  • Suggested answer
    M.Azwar Alam Profile Picture
    M.Azwar Alam on at
    RE: Huge Data Import CRM Online

    You can write Console App for this and schedule that console App in windows task scheduler

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Community AMA December 12th

Join us as we continue to demystify the Dynamics 365 Contact Center

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,240 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,149 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans