web
You’re offline. This is a read only version of the page.
close
Skip to main content

Announcements

No record found.

News and Announcements icon
Community site session details

Community site session details

Session Id :
Dynamics 365 Community / Forums / Customer experience | Sales, Customer Insights,... / Data Ingestion Interna...
Customer experience | Sales, Customer Insights,...
Unanswered

Data Ingestion Internal Error

(1) ShareShare
ReportReport
Posted on by Kulbhushan Katoch Microsoft Employee

While trying to load data in CI, it is giving me some internal error.

There is some update in UI to create data source and add entities now, however last month, it worked fine.

Steps performed: 

1. Exported Gen1 SStreams to Gen2 in parquet format using ADF.

 2. Created new ADLS data source referring Gen2 container and added required manifest files and one entity (pointing to parquet files in Gen2) with 139 columns. 

Error:
Could not load data for the entity 'cpddsrc_sch_cpdmster' due to an internal error. Please try again and if the problem persists contact support.
 
Post ingestion job failed. DataSourceId: 'e79036b7-baa2-41fb-bd14-209c4f27a36b', DataflowId: 'e79036b7-baa2-41fb-bd14-209c4f27a36b'.

pastedimage1657704221663v1.png

Let us know what causing this failure and resolution.

  • Mukesh Pohuja Profile Picture
    Mukesh Pohuja Microsoft Employee on at
    [quote user="Kulbhushan Katoch"]

    While trying to load data in CI, it is giving me some internal error.

    There is some update in UI to create data source and add entities now, however last month, it worked fine.

    Steps performed: 

    1. Exported Gen1 SStreams to Gen2 in parquet format using ADF.

     2. Created new ADLS data source referring Gen2 container and added required manifest files and one entity (pointing to parquet files in Gen2) with 139 columns. 

    Error:
    Could not load data for the entity 'cpddsrc_sch_cpdmster' due to an internal error. Please try again and if the problem persists contact support.
     
    Post ingestion job failed. DataSourceId: 'e79036b7-baa2-41fb-bd14-209c4f27a36b', DataflowId: 'e79036b7-baa2-41fb-bd14-209c4f27a36b'.

    pastedimage1657704221663v1.png

    Let us know what causing this failure and resolution.

    [/quote]

    Hi Kulbushan - were you able to get past this error? 

    were you able to view the parquet file in any other tool to verify if there are any col or data type mismatches?

    If its still an issue, pls file a support ticket at http://aka.ms/cisupport with the instance info for further investigation. 

    thanks,

    mukesh

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Season of Sharing Community Challenge Winners!

Congratulations to our community stars!

Women in Power Builds Momentum

Expanding mentorship, skilling, and AI innovation

Congratulations to the September Top 10 Community Leaders

These are the community rock stars!

Leaderboard > Customer experience | Sales, Customer Insights, CRM

#1
Daniyal Khaleel Profile Picture

Daniyal Khaleel 103 Most Valuable Professional

#2
11manish Profile Picture

11manish 69 Super User 2026 Season 2

#3
Travis South Profile Picture

Travis South 50

Last 30 days Overall leaderboard

Featured topics

Hide selecting Contact for potential customer when creating quote

Product updates

Dynamics 365 release plans