Skip to main content

Notifications

Announcements

No record found.

Dynamics 365 general forum
Unanswered

ADF pipeline failed - Copy data from Dynamics 365 to Dynamics 365

Posted on by
Hi,

We are getting the following error while execution of ADF pipeline:

Failure happened on 'Source' side. ErrorCode=DynamicsOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Dynamics operation failed with error code: -2147187341, error message: The database operation timed out; this may be due to a leading wildcard value being used in a filter condition. Please consider removing filter conditions on leading wildcard values, as these filter conditions are expensive and may cause timeouts..,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,'

Query in the source, indeed contains the following filter conditions with wildcards but they are necessary:
In the past, there were times when ADF pipeline has run successfully.
 
<filter>
<condition attribute="kns_nameofvaccinator" operator="not-like" value="%\%" />
<condition attribute="kns_batchnumber" operator="not-like" value="%\%" />
<condition attribute="kns_nameofvaccinator" operator="not-like" value="%/%" />
<condition attribute="kns_batchnumber" operator="not-like" value="%/%" />
<condition attribute="kns_nameofvaccinator" operator="not-like" value="%|%" />
<condition attribute="kns_batchnumber" operator="not-like" value="%|%" />
<condition attribute="kns_batchnumber" operator="not-like" value="%&quot;%" />

In the past, there were times when ADF pipeline has run successfully.

Anyone any ideas?
Categories:
  • ADF pipeline failed - Copy data from Dynamics 365 to Dynamics 365
    Hi Anthony,

    Thanks a lot for heads-up. This is what I can see in case of the successful run:



    And the below in the case of failed one:



    As can be seen the order of the magnitude is pretty much the same. 
  • Anthony Blake Profile Picture
    Anthony Blake 2,014 Super User 2024 Season 2 on at
    ADF pipeline failed - Copy data from Dynamics 365 to Dynamics 365
    Hi, 
     
    On past successful runs, did the running time come close to timing out?
     
    Can you change it to be more selective (e.g. add criteria to select a small number of records) to retest and rule out a genuine timeout problem?
     
    Anthony

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Anton Venter – Community Spotlight

Kudos to our October Community Star of the month!

Announcing Our 2024 Season 2 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 290,665 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 228,971 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,150

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans