web

You’re offline. This is a read only version of the page.

News and Announcements icon

Dynamics 365 CommunityForums Service | Customer Service, Contact Center, Fie... Load data from DataLak...

Service | Customer Service, Contact Center, Fie...

Unanswered

Load data from DataLake to Azure SQL DB

(0) Share

Report

Report

Posted on by rajkm

69

Hi,

We have got D365 CE data landed in Data Lake.

Now, I need to pull data to Azure SQL DB from DL. As suggested by MS, I am using ADF pipeline.

My pipeline is working fine in full load every time.

I need to run incremental load. How do I get latest rows in the entity(created/modified/deleted) like modifiedon.

Is it possible?

If I am able to get these new/changed rows, I can configure my pipeline to just import changes instead of all rows every time.

Thanks in advance

I have the same question (0)

All responses Img

All responses (1)

Answers Img

Answers (0)

Tex_01 50 on at

Like (0)

Report
Copy link

Link copied!

You will need to add a process called a "Watermark" to lookup or hold the last modified date and then you use this in your select statement in your pipeline. If you google Data Factory using Watermarks there are some very good tutorials.

Was this reply helpful? Yes No

Join the conversation

Helpful resources

Quick Links

Leaderboard > Service | Customer Service, Contact Center, Field Service, Guides

#1

#2

Tom_Gioielli 23 Super User 2026 Season 1

#3

Encore Business Sol... 14

Last 30 days Overall leaderboard

Featured topics

Product updates

Dynamics 365 release plans