Synapse views duplicating data with columns Start_LSn and DML_Action

(0) Share

Report

Posted on by Paulo Menezes

177

After implement Data Lake export with Azure function, the views were created on Synapse Database (Serverless). The problem is that after some time, the 'cdm.json' files are automatically updated and after that some new columns are created with the information of each update for the data.

If the same csv files and json files that is being used by Synapse Views are consumed by DataBricks or Synapse notebooks, just one line is returned. So, the problem is with Synapse Views or Azure Function

Is there any option in Azure Function to maintain just the last update of data?

We are using the project of https://github.com/microsoft/Dynamics-365-FastTrack-Implementation-Assets.

I have the same question (0)