Hi,
Am trying to load the on premise SQL DB tables to Azure Data lake.
i have created the corresponding linked services and exported the data from SQL DB to Azure Data Lake.
Now i need to load the incremental push records. This one also i have achieved using change tracking technology. (using Azure Data factory i have done this, any other recommended solutions also acceptable).
Now both files are seperate files in Azure Data Lake.
How i need to update the incremental push records into an existing file without disturbing the other records which are not modified.
Because if am trying to merge those two files and it will create the new seperate file only. So finally extra data count occurs (data which are not modified also need to write the new file).
So is there any way to push the incremental records in the existing file without disturbing the unmodified records in existing file.