Performance of data Integration for CRM 2016 using Scribe

(0) Share

Report

Posted on by Community Member

Hello,

I have an Application based on SQL-Server 2012 Standard on one VM and CRM Application on another VM. The Scribe Server and CRM database are both on the third VM. The data integrations like Update/Insert or Delete Operations on CRM database occures over Scribe as Middelware.

Now we have a greate Problem for this Integration, because it takes too many times, for example for 873 records approximately 6 hours and for 3217 records 23 hours.

Has anybody an idea about that?

Thanks a lot in advance for your help.

*This post is locked for comments

I have the same question (0)

All responses (5)

Answers (0)

Sort by

Suggested answer

Wayne Walton 13,730 on at

Like (0)

Report
Copy link

Link copied!

What are the specs of your VMs and what are the specs of the Host the VMs are on? That looks like one of two things:

1. Your VMs are underallocated and you're getting serious resource contention

2. Your insert and update calls in Scribe are highly complex with a lot of step dependencies that forces Scribe to make multiple calls to CRM for each update.

If it's the first, put it on stronger hardware. If it's the second, try and streamline the integration to do everything in only one or two conditions.

Was this reply helpful? Yes No
Abhilash M abi 595 on at

Like (0)

Report
Copy link

Link copied!

Hello Wayne,

There are only two steps in the DTS file for updating the contacts. so i think we are facing problem with the VM memory allocation.

Was this reply helpful? Yes No
Community Member on at

Like (0)

Report
Copy link

Link copied!

Hello Wayne,

I see in the Test-Window of the Scribe Workbench, that the load process for each row (includes 83 Fields also with functions) takes a Long time. I know that scribe needs time for formating the fields value bevor to write them in to crm table ( ContactBase) in the CRM Database and I have only two steps in the Target

for the Update/Insert Operation.

Was this reply helpful? Yes No
Wayne Walton 13,730 on at

Like (0)

Report
Copy link

Link copied!

Your VMs might be I/O (like hard drive) limited. Also, if your formatting is complex, that can cause issues. Do you need all 83 fields, or can you cut that down?

Was this reply helpful? Yes No
Community Member on at

Like (0)

Report
Copy link

Link copied!

I will investigate the matter on monday.But what i know there are some fields in the source that are not mapped to the Target at all and if I count them then we would have totaly 88 fields .

Was this reply helpful? Yes No