Skip to main content

Notifications

Announcements

No record found.

News and Announcements icon
Dynamics 365 Community / Forums / Customer experience | Sales, Customer Insights,... / Exports Nested folders
Customer experience | Sales, Customer Insights,...
Unanswered

Exports Nested folders

(2) ShareShare
ReportReport
Posted on by Community member 5
Hi,
Customer Insights supports exporting tables, measures and segments to Azure Data Lake Storage Gen2 but the exports create a nested file structure which makes it difficult for external tools to consume without recursive logic navigating the folders.
 
 
Example container structure for 'AccountTable'
  • 2024
    • 02
      • 21
        • 1855
          • accounttable.csv 
 

What OOB options are available to support a single file export for simple consumption? Can we modify the export format? 
 
What custom options are available within Azure to consume and export an aggregated file for consumption? (If I were in AWS, I would attempt to create a Lambda function that transforms the data into a new format and write to the destination)
  • CU22060803-1 Profile Picture
    CU22060803-1 2 on at
    Exports Nested folders

    To simplify file exports from fnaf online Customer Insights to Azure Data Lake Storage Gen2, consider using Azure Data Factory or Azure Databricks to aggregate nested files into a single file or simpler directory structure after each export.

  • Community member Profile Picture
    Community member 2 on at
    Exports Nested folders
    Hello, one option is to export the tables, measures, and segments individually using Customer Insights' export functionality. Then, you can use local scripting or programming tools to combine the individual files into a single file that is easier to consume. This approach gives you full control over the exported format.
    Custom Options within Azure:
    1. Azure Data Factory: Azure Data Factory (ADF) can be used to orchestrate data movement and transformation workflows. You can create an ADF pipeline that exports the data from Customer Insights to Azure Data Lake Storage Gen2 in the desired format. Within the pipeline, you can use mapping data flows or custom activities to aggregate and transform the data as needed.
    2. Azure Databricks: Azure Databricks provides a scalable analytics platform that can be used for data transformation and processing. You can write custom scripts using languages like Python or Scala to read the exported data from Customer Insights, aggregate it, and create a new file in the desired format.
    3. Azure Functions: Azure Functions can be utilized to write custom code that triggers on specific events, such as the availability of new data in Customer Insights or changes in the data lake. You can write a function that reads the exported data, performs the necessary transformations, and writes the aggregated data to the destination in the desired format.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Congratulations 2024 Spotlight Honorees!

Kudos to all of our 2024 community stars! 🎉

Meet the Top 10 leaders for December!

Congratulations to our December super stars! 🥳

Get Started Blogging in the Community

Hosted or syndicated blogging is available! ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,642 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,371 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans