web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

No record found.

Community site session details

Community site session details

Session Id :
Microsoft Dynamics 365 | Integration, Dataverse...
Answered

Allow for XML schema drift in ADF Copy Data activity (from Fetch XML)

(0) ShareShare
ReportReport
Posted on by 5

I have observed the same issue as reported in   .
Essentially, when you have a column that is sparsely populated (mostly contains NULLs) from a FetchXML query, the column may not be returned at all by your ADF Copy Data action.  I believe this occurs because fetchXML does not return the attribute tag in the output when the value for the record is null. 

This problem can be resolved by providing a fixed mapping to ADF.  However, my issue is that I'd like to allow for schema drift (e.g. new field added to the source table in Fetch XML) when copying data in ADF and I wondered if there is an alternative solution that would address this requirement?

I have the same question (0)
  • Verified answer
    DAnny3211 Profile Picture
    11,397 on at

    hi

    One possible solution to address this requirement is to use a dynamic mapping approach in ADF. This involves using a combination of dynamic content and metadata-driven mappings to handle schema drift.

    In this approach, you can use dynamic content to extract the schema information from the source dataset and use metadata-driven mappings to dynamically map the columns based on their names and data types. This way, if a new field is added to the source table in FetchXML, it will automatically be included in the mapping without the need for manual updates.

    To implement this approach, you can use the dynamic content feature in ADF to extract the schema information from the source dataset. You can then use this information to dynamically generate the mapping structure using metadata-driven mappings. This can be done using an ADF Data Flow with a metadata-driven mapping transformation, which can dynamically map the columns based on their names and data types.

    Overall, this approach can provide a flexible and scalable solution to handle schema drift in FetchXML queries when copying data in ADF.

    DAniele

  • kade.hyland Profile Picture
    5 on at

    Thanks for the detailed response Daniele.  I'll have to do some research to determine the best way to collect the metadata for the mapping, but the process you describe makes sense to me and I really appreciate it.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Neeraj Kumar – Community Spotlight

We are honored to recognize Neeraj Kumar as our Community Spotlight honoree for…

Leaderboard > Microsoft Dynamics 365 | Integration, Dataverse, and general topics

#1
Siv Sagar Profile Picture

Siv Sagar 93 Super User 2025 Season 2

#2
#ManoVerse Profile Picture

#ManoVerse 76

#3
Martin Dráb Profile Picture

Martin Dráb 64 Most Valuable Professional

Last 30 days Overall leaderboard

Product updates

Dynamics 365 release plans