Dynamics CRM SSIS data integration Kingswaysoft

(0) Share

Report

Posted on by Community Member

Hello,

I'd like to know (more or less) if our duration for the data import is acceptable or something is wrong.

A system integrator realized our system.

To sync data between SQL server tables and DYNAMICS CRM 2016 (both virtual server in local) it takes lot of hours (up to 72 hours).

Example:

I have 2 tables in sql server database with about 424.000 records.

The tables have about 30-35 columns in total.

The sync takes about 4 hours and 50 minutes.

It this time acceptable and realistic or someone is doing his job wrong?

Thank you for help.

*This post is locked for comments

I have the same question (0)

All responses (4)

Answers (0)

Thomas David Dayman 11,323 on at

Like (0)

Report

Are you saying that your table has 424,000 records?

It should be less than a minute to do. It also depends on what data manipulation is going on underneath.

What type of data is it migrating?

Was this reply helpful? Yes No
Community Member on at

Like (0)

Report

My company has an old informix db.

The first step is to populate tables in sql server db from informix with agents, invoices, sales receipt, clients and this operation takes about 15 minutes. (I do this step)

Then the system integrator takes the data from those tables (I think with SSIS and Kingswaysoft, but I'm not expert) and import with a stored procedure in DYNAMICS CRM tables.

From system logs I see those import steps takes forever.

They says that there are lots of records and the duration is right.

Is there any verify I can do?

Was this reply helpful? Yes No
Thomas David Dayman 11,323 on at

Like (0)

Report

It really is hard to say unless I was able to see it SSIS Package for myself.

If its literally taking standard text/number data from a external db and moving it into CRM then something might be up. You might want to investigate further.

For example I once did a attachment migration from CRM to SharePoint with lots of data manipulation and It took the same amount of time as your operation did of around 5 hours and that's dealing with large image data per record.

Was this reply helpful? Yes No
Suggested answer

PranavShroti 4,510 on at

Like (0)

Report

SSIS allows parallel execution, which can speedup your data transfer. In my experience I have observed people making this mistake quite often as they rely for one-by-one execution. First thing you can review is if your implimentation partner is enabling parallel execution?

More information:

blogs.msdn.microsoft.com/.../implement-parallel-execution-in-ssis

www.powerobjects.com/.../11-dynamics-crm-data-migration-tips

Additionally you can also:

Turn on SQL Server RSCI (Read Committed Snapshot Isolation)

Add NOLOCK in FetchXml Query

Set the Max Degree of Parallelism of SQL Server to 1. (Recommended for CRM database but not for data warehouse)

Regards,

Pranav

If found useful, please mark the answer as verified

Was this reply helpful? Yes No