Skip to main content

Notifications

Finance | Project Operations, Human Resources, ...
Unanswered

Migrate 1.7TB of data to Microsoft Fabric and setup real time connectivity

Posted on by
I am trying to connect and migrate data from Dynamic FO to   Microsoft Fabric. I have tried via dataverse dual-write enablement and then connected dataverse with Fabric via synapse link. issue is dataverse does not allow 500,000 rows of data. so i am cannot move large tables due to that. I am struggling to find the solution/approach that help achieve following:
- Migrate historical data to Fabric - and do reporting and AI use cases there 
- Make data modeling/data mapping simple (data verse helps with that, that is choose dataverse)
- Integrate Fabric with dymaic to capture real time chnages in the data 
- Digitize workflows via powerapps on top of dataverse. 
 
 
Please advise me if i am thinking wrong and what should i do? 
  • Hana Xue Profile Picture
    Hana Xue Microsoft Employee on at
    Migrate 1.7TB of data to Microsoft Fabric and setup real time connectivity
    Hi,
    The documentation mentions that if you must have more than 500,000 rows in the run when using initial sync, it is recommended that you migrate the data into the Finance and Operations apps and the Dataverse respectively and skip the initial sync.
    dynamics-365-unified-operations-public/articles/fin-ops-core/dev-itpro/data-entities/dual-write/initial-sync-guidance.md at main · MicrosoftDocs/dynamics-365-unified-operations-public · GitHub


    Best Regards,
    Hana

     
  • André Arnaud de Calavon Profile Picture
    André Arnaud de Cal... 291,253 Super User 2024 Season 2 on at
    Migrate 1.7TB of data to Microsoft Fabric and setup real time connectivity
    Hi Syed,
     
    You can use the Synapse link for F&O. You can read more about it here: Choose finance and operations data in Azure Synapse Link for Dataverse - Power Apps | Microsoft Learn
    Note that this link will be near real time as it is an async process. 
     
     
     
     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Community AMA December 12th

Join us as we continue to demystify the Dynamics 365 Contact Center

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,253 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,188 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Product updates

Dynamics 365 release plans