Skip to main content

Notifications

Announcements

No record found.

Microsoft Dynamics 365 | Integration, Dataverse...
Unanswered

FetchXML Query Missing Columns with NULL values

(1) ShareShare
ReportReport
Posted on by 10

Hi,

Hope am reaching out to the right corner of Dynamics 365. 

Below is the issue encountered while loading data using Azure Data Factory:

To extract the data from Dynamics 365 source using Azure Data Factory, we are using XML query in ADF which defines only specific set of columns to be pulled from the source. However, it has been noticed that though we define the column names(attribute names), few columns are missing out after the data is loaded into Data Lake file(.csv).

Here is an example for better clarification: Below is the XML query which has 9 columns but only 7 columns are getting extracted, upon checking the data we see the missing columns has large no. of NULL/ALL NULL values in the source. Kindly, please advice if there is any feasible solution to handle such scenarios.

<fetch version="1.0" output-format="xml-platform" mapping="logical" distinct="false">
<entity name="xts_employee">
<attribute name="createddate" />
<attribute name="modifieddate" />
<attribute name="xts_employeeid" />
<attribute name="xts_businessunitid" />
<attribute name="xts_employeetype" />
<attribute name="xts_status" />
<attribute name="xts_employeeregion" />
<attribute name="xts_joindate" />
<attribute name="xts_resigndate" />
</entity>
</fetch> 

Thanks & Regards,

Pramod.

  • LeoAlt Profile Picture
    LeoAlt 16,329 on at
    RE: FetchXML Query Missing Columns with NULL values

    Hi Partner,

    If the column data is null which means sparse, columns without any value in top rows would be missing. we suggest that you could use explicit column mapping.

    I also find this thread about the same issue for you.

    https://github.com/MicrosoftDocs/azure-docs/issues/21216

    Regards,

    Leo

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Tips for Writing Effective Verified Answers

Best practices for providing successful forum answers ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,419 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,492 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Product updates

Dynamics 365 release plans