Dynamics 365 data in ALDS to parquet format and Delta tables in Databricks

(1) Share

Report

Posted on by MJ-24090752-0

Hi.

We need to pull the incremental data from dynamics 365 FnO to azure data lake. As per the MS documents we identified Synapse link for Dataverse is one of the option to push the incremental data into azure data lake.

We tried this option, however it push the data in csv format for data and for metadata it creates json files.

Also it creates different folders for each incremental loads.

Now problem is the reading the json and csv files using data factory will be challenging.

Therefore, I we are looking for a best option to read the D364 exported data from ADLS and convert them into delta tables or other tablular formats

I have the same question (0)

All responses (1)

Answers (0)

Martin Dráb 235,987 Most Valuable Professional on at

Like (0)

Report

Dynamics 365 data in ALDS to parquet format and Delta tables in Databricks

Using Parquet rather than CSV is not only supported by Synapse Link for Dataverse, but it's even recommended. Look for details in documentation, e.g. Export Dataverse data in Delta Lake format.

Was this reply helpful? Yes No