Skip to main content

Notifications

Announcements

No record found.

Microsoft Dynamics CRM (Archived)

To be update thousands ( 1,00,000) of records in CRM daily through batch job

Posted on by 187

I have requirement to  update more that 1,00,000 records in CRM daily through batch job. Can anyone suggest, Which one is better approach, either Console Application or SSIS package. Batch should not take more than 6 hrs to finish. Please suggest any better approach with examples.

*This post is locked for comments

  • Suggested answer
    Adrian Begovich Profile Picture
    Adrian Begovich 21,009 Super User 2024 Season 2 on at
    RE: To be update thousands ( 1,00,000) of records in CRM daily through batch job

    Hi Balaji Karpurapu,

    Based on my testing, there is a considerable difference in speed for this task between SQL Server Integration Services (SSIS) and console applications. I recommend using SSIS as it is faster, more reliable, and it is easy to schedule SSIS Packages to run daily with SQL Server Agent Jobs.

  • Suggested answer
    Pawar Pravin  Profile Picture
    Pawar Pravin 5,227 on at
    RE: To be update thousands ( 1,00,000) of records in CRM daily through batch job

    Hi Balaji,

    As concern with time and performance, I can suggest you to use SSIS packages. Even if for complex business logic as well you can handle in SSIS using "Script Component".

    Also you can create success and failed job list using packages.

  • Verified answer
    RaviKashyap Profile Picture
    RaviKashyap 55,410 on at
    RE: To be update thousands ( 1,00,000) of records in CRM daily through batch job

    Hi,

    I don't think there would be any significant difference between ssis and console application. The decision will be based on what is more comfortable to you i.e. are you more comfortable in SSIS or writing custom c# code. Perfoemance wise both will use crm service so no major difference. However if you need to selecct some data from a different source say some other sql server then ssis would be better as you can directly connect and extract your data where as in console you need to connect to db and then retrieve teh values.

    Personally I would prefer SSIS over writing a console application if there is no major if else logic on update. If there is any complex business logic involved then I will go for console app.

    Hope this helps.

  • Verified answer
    PranavShroti Profile Picture
    PranavShroti 4,510 on at
    RE: To be update thousands ( 1,00,000) of records in CRM daily through batch job

    Two options you have:

    1. SSIS package with help of some 3 party tool like KingswaySoft connector.

    2. SCRIBE packages. -

    Both options will serve you good... SSIS + KingswaySoft will be a cost effective option.. scribe is bit costly comparatively.

    Regards,

    Pranav

    If found useful, please mark the answer as verified

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Tips for Writing Effective Suggested Answers

Best practices for providing successful forum answers ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,280 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,214 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans