Skip to main content

Notifications

Announcements

No record found.

Customer Insights - Data forum
Unanswered

Data Import Error (schema mismatch)

Posted on by 45

Hi Community,

We are loading several tables form a Azure data lake Gen2 (CDM folders). The system is in productive use since a few months where we built several (complex) measures and segments.

Recently we recently realized import errors on several tables where the error message says:

Error: Number of columns in source data file does not match the number of attributes: {AttributeCount} defined in the source data schema for the entity '[table name]'

(The data still seems to load correctly)

When I try to review/edit the data source, CI tells me I have to first remove the table from all relationships/measures/segements etc. This would be a massive task and cause a downtime for several days (basically we would have to "rebuild" almost everything).

How can I find out which columns are causing the issue? Is there any other way to analyze this and "reset" the data schema within CI and fix this?

  • RE: Data Import Error (schema mismatch)

    can you reach out to CIHelp@microsoft.com for investigation?

  • Johannes Wagner Profile Picture
    Johannes Wagner 45 on at
    RE: Data Import Error (schema mismatch)

    Hi Mukesh, thanks for your suggestions

    1) No. All ADLS refreshes are complete when CI refreh startes

    2) Yes. There are issues with line breaks that cause "corrupt" records (this is yet another problem)

    3) Yes. However, this occurs in different entities not related to the schema error

  • RE: Data Import Error (schema mismatch)

    1. Were the files on the ADLS still in the middle of a refresh, before the Data source refresh started? 

     2. Any chance there are new lines in the data, thats throwing off the col counts.

    3. Under entities, Is there a corrupt entity that you can check for data skew?

Helpful resources

Quick Links

Replay now available! Dynamics 365 Community Call (CRM Edition)

Catch up on the first D365 Community Call held on 7/10

Community Spotlight of the Month

Kudos to Saurav Dhyani!

Congratulations to the June Top 10 community leaders!

These stars go above and beyond . . .

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 287,986 Super User

#2
Martin Dráb Profile Picture

Martin Dráb 225,588 Super User

#3
nmaenpaa Profile Picture

nmaenpaa 101,148

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans