web
You’re offline. This is a read only version of the page.
close
Skip to main content

Notifications

Announcements

No record found.

Community site session details

Community site session details

Session Id :
Finance | Project Operations, Human Resources, ...
Answered

Export to Data Lake - Deleting Old entries from the Datalake

(0) ShareShare
ReportReport
Posted on by 15

HI All, Wondering any one understand the process of changed data capture with main tables when we export data from F&O to datalake?

For example - this is the snapshot of LogisticsPostalAddress .csv file  from the Datalake, I noticed each and every time when I change the data in the F&O -Custtable there will be an entry in this table. So this table holds the previous address and as well as the current address. I can easily write an sql query and get the latest address but my worry is if these table grows Is there any settings in F&O to delete the old entries from the Datalake CSV files.  I'm mostly worried about the main Finance related tables as the volumes can grow rapidly on a daily basis. Any pointers will be highly appreciated.

pastedimage1653723693266v3.png

pastedimage1653723397108v1.png

I have the same question (0)
  • Verified answer
    André Arnaud de Calavon Profile Picture
    301,075 Super User 2025 Season 2 on at

    Hi NewRookie,

    When you change or delete addresses in Dynamics 365 F&O, the actual records will not be deleted, but they get a timestamp in the ValidTo field which makes the record not an active address. For that reason, there is no delete action triggered. The purpose of this behavior is to be able to do audits on address changes. Dynamics 365 F&O does not have an option to delete addresses from the application and also not for address storage in DataLake.

    If you want to clean up older data in Data Lake for the addresses, you have to manage this yourself.

  • NewRookie Profile Picture
    15 on at

    Thanks Andre . One last Query - Is it just the Customer got this behaviour or other master data tables as well?  I'm mainly focused on transaction tables for example Ventrans and other GL related tables.

  • Verified answer
    André Arnaud de Calavon Profile Picture
    301,075 Super User 2025 Season 2 on at

    Hi NewRookie,

    This behavior is with tables which do support date effectiveness. Addresses, currency exchange rates, and HR position assignments are some of the examples. The customer table itself is not supporting the date effective framework. That will trigger delete actions.

    You also mentioned transaction tables. Customer, vendor and GL transactions are not deleted from the application.

  • NewRookie Profile Picture
    15 on at

    Thanks Andre

  • Martin Dráb Profile Picture
    237,965 Most Valuable Professional on at

    Please don't forget verifying the answer (by using Did this answer your question? > Yes) on the reply (or replies) answering the question.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Neeraj Kumar – Community Spotlight

We are honored to recognize Neeraj Kumar as our Community Spotlight honoree for…

Leaderboard > Finance | Project Operations, Human Resources, AX, GP, SL

#1
Martin Dráb Profile Picture

Martin Dráb 592 Most Valuable Professional

#2
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 478 Super User 2025 Season 2

#3
BillurSamdancioglu Profile Picture

BillurSamdancioglu 305 Most Valuable Professional

Last 30 days Overall leaderboard

Product updates

Dynamics 365 release plans