Skip to main content

Notifications

Customer experience | Sales, Customer Insights,...
Suggested answer

Can I ingest JSON files stored in ADL by using "Azure Data Lake Storage" (not with Import Mode or Power Query)?

(1) ShareShare
ReportReport
Posted on by 87

Hi CI Community,

I do have a large amount of data that is available in JSON format, which I'd upload to ADL, from which CI can ingest directly.

Since this is a large amount of data, Power Query (import mode) is not suitable.

The common way to do is to store the files either in CSV or Parquet format in ADL, getting the CDM entity data, so that CI can ingest the data directly from there.

But does it also work with JSON files? 

Looking forward to your feedback.

Reddy

  • Suggested answer
    Bill Ryan Profile Picture
    Bill Ryan 8 on at
    RE: Can I ingest JSON files stored in ADL by using "Azure Data Lake Storage" (not with Import Mode or Power Query)?

    The traditional problems with Power Query were often around the transformations being done but yah, if there's a really large # of records it could be problematic.  Right now, Power Platform data flows can be used for JSON and should play well with your JSON structure.  You could store JSON in parquet but in this case it would just be a problem. As of today looking in github JSON isn't supported as a file format (you can always ask, they may have it in the works somewhere if you mention it on github) but I think you're best bet is to use PPDF.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Vahid Ghafarpour – Community Spotlight

We are excited to recognize Vahid Ghafarpour as our February 2025 Community…

Congratulations to the January Top 10 leaders!

Check out the January community rock stars...

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 292,074 Super User 2025 Season 1

#2
Martin Dráb Profile Picture

Martin Dráb 230,900 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans