Skip to main content

Notifications

Customer experience | Sales, Customer Insights,...
Unanswered

Data Ingestion Internal Error

(1) ShareShare
ReportReport
Posted on by

While trying to load data in CI, it is giving me some internal error.

There is some update in UI to create data source and add entities now, however last month, it worked fine.

Steps performed: 

1. Exported Gen1 SStreams to Gen2 in parquet format using ADF.

 2. Created new ADLS data source referring Gen2 container and added required manifest files and one entity (pointing to parquet files in Gen2) with 139 columns. 

Error:
Could not load data for the entity 'cpddsrc_sch_cpdmster' due to an internal error. Please try again and if the problem persists contact support.
 
Post ingestion job failed. DataSourceId: 'e79036b7-baa2-41fb-bd14-209c4f27a36b', DataflowId: 'e79036b7-baa2-41fb-bd14-209c4f27a36b'.

pastedimage1657704221663v1.png

Let us know what causing this failure and resolution.

  • RE: Data Ingestion Internal Error
    [quote user="Kulbhushan Katoch"]

    While trying to load data in CI, it is giving me some internal error.

    There is some update in UI to create data source and add entities now, however last month, it worked fine.

    Steps performed: 

    1. Exported Gen1 SStreams to Gen2 in parquet format using ADF.

     2. Created new ADLS data source referring Gen2 container and added required manifest files and one entity (pointing to parquet files in Gen2) with 139 columns. 

    Error:
    Could not load data for the entity 'cpddsrc_sch_cpdmster' due to an internal error. Please try again and if the problem persists contact support.
     
    Post ingestion job failed. DataSourceId: 'e79036b7-baa2-41fb-bd14-209c4f27a36b', DataflowId: 'e79036b7-baa2-41fb-bd14-209c4f27a36b'.

    pastedimage1657704221663v1.png

    Let us know what causing this failure and resolution.

    [/quote]

    Hi Kulbushan - were you able to get past this error? 

    were you able to view the parquet file in any other tool to verify if there are any col or data type mismatches?

    If its still an issue, pls file a support ticket at http://aka.ms/cisupport with the instance info for further investigation. 

    thanks,

    mukesh

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Vahid Ghafarpour – Community Spotlight

We are excited to recognize Vahid Ghafarpour as our February 2025 Community…

Congratulations to the January Top 10 leaders!

Check out the January community rock stars...

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 292,074 Super User 2025 Season 1

#2
Martin Dráb Profile Picture

Martin Dráb 230,900 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans