web
You’re offline. This is a read only version of the page.
close
Skip to main content
Community site session details

Community site session details

Session Id :
Finance | Project Operations, Human Resources, ...
Answered

Data Warehouse concept Export to Data lake - D365 FO VS CDS

(0) ShareShare
ReportReport
Posted on by

Microsoft got me a bit confused on this one. Both these features export data in the common data model format for analytical purposes. 

D365 FO - https://docs.microsoft.com/en-us/dynamics365/fin-ops-core/dev-itpro/data-entities/finance-data-azure-data-lake

CDS - https://docs.microsoft.com/en-us/powerapps/maker/common-data-service/export-to-data-lake

It's not clear to me why these features would be introduced at two locations. It would be more obvious to have the CDS as central hub for data across the different Dynamics365-apps. However, with this feature being introduced in D365 FO, will every D365-app get its own 'export to data lake'- feature? Unclear what would be best practice to use in future analytical scenarios. 

Any ideas?

I have the same question (0)
  • Verified answer
    nmaenpaa Profile Picture
    101,160 Moderator on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    When you export directly from D365FO to Data lake, you will be able to export tables. But D365FO - CDS integration is based on data entities, so if you would go through D365FO - CDS - ADLS you could only export entity data.

  • Suggested answer
    vinitgoyal2005 Profile Picture
    6,332 on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    Hi,

    CDS holds the data from D365 Sales, Customer service, and a few other apps. It contains some data from D365FO if Dual write is configured.

    Export to data lake from D365FO is a replacement for the BYODW concept of D365FO. This data will be used for reporting, power Apps and any other external tools/integration. Also, Dual write uses OData which is slow whereas Export to data lake uses the change capture data method which is way better and hence the data in Lake would be near real-time.

  • Sergei Minozhenko Profile Picture
    23,093 on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    Hi Wouter Dunnes,

    CDS has a more broad purpose than storage backend for Dynamics apps. You can create a custom CDS environment and create your own entities without any connection to Dynamics products.

    Literally we have 2 different storage backends here: Azure SQL (F&O) and CDS (Dynamics apps) and that why there are 2 different integrations to DL.

    To follow your logic, if customer buys F&O and if they want to have integration with DL, they need to buy another app based on CDS to be able to export data. But doesn't sound like good option.

  • Community Member Profile Picture
    on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    Hi Sergei,

    Isn't Common Data Service included in the F&O license? I thought you only need to buy (additional) capacity cds storage-wise?

  • Community Member Profile Picture
    on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    Hi Vinit,

    Isn't Dual Write made for near real-time processing from/to CDS?

  • Community Member Profile Picture
    on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    Hi Nikolaos,

    This seems to be the correct answer. To me it is unclear what the limitations are between exporting data entities or tables? In which situation would you use Tables vs Data Entities?

  • Verified answer
    nmaenpaa Profile Picture
    101,160 Moderator on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    Tables contain the actual data in D365FO database, in the native data model. Data entities are abstractions built on top of tables. Not all tables are covered by data entities, for example CustTrans, VendTrans, InventTrans. Until now you have needed to develop a data entity if you wanted to export that data for reporting purposes. There were some special hoops needed because normally data entities can only be created in tables that have a natural key.

  • Community Member Profile Picture
    on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    Ah! Is there a list available what is included/excluded in the data entities?

    So when exporting the tables, we would need some mapping (with e.g. Azure Databricks) to make the relations between VendTrans & Vendor, while the data entities already have pre-defined relationships?

  • Verified answer
    nmaenpaa Profile Picture
    101,160 Moderator on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    No, there's no list. But you can use Cross references (right click any object, including table -> Find references) in Visual Studio in a D365FO to see all references to that object. So you can see which data entities (if any) are using some table.

    No matter if you export entities or tables, you would need to define the relations between different tables / entities when you use the data.

  • Sergei Minozhenko Profile Picture
    23,093 on at
    RE: Data Warehouse concept Export to Data lake - D365 FO VS CDS

    Hi Wouter Dunnes,

    Yes, you are right, one production CDS environment is included in F&O license.

    My point was that CDS and Azure SQL (F&O) are just different backend storage. Data lake is centralized storage where you can bring data from different sources, like CDS , Azure SQL, telemetry, data from 3rd party app, IoT and so it.

    Even if tables synchronization will be enabled between F&O and CDS, do you really want to pay for additional costs for CDS and use it just for data transfer between F&O and Data lake?

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Abhilash Warrier – Community Spotlight

We are honored to recognize Abhilash Warrier as our Community Spotlight honoree for…

Leaderboard > Finance | Project Operations, Human Resources, AX, GP, SL

#1
CA Neeraj Kumar Profile Picture

CA Neeraj Kumar 2,157

#2
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 883 Super User 2025 Season 2

#3
Sohaib Cheema Profile Picture

Sohaib Cheema 674 User Group Leader

Last 30 days Overall leaderboard

Product updates

Dynamics 365 release plans