Skip to main content

Notifications

Small and medium business | Business Central, N...
Suggested answer

Data insert from Business Central to Dataverse

Posted on by 501

Hi everyone, 

I completed Yun Zhu's Tutrorial on Custom Dataverse insert data from Business Central to Dataverse.
Everything works fine. I can Insert, delete and modify records in Dataverse. 

I started with a Full Synchronization of the G/L Entry over the weekend. It's about 700,000 records. 
After about 2 Days and 100,000 records later it seemed to have stopped inserting but there is no finished time.

My questions are the following.
Is there a limit on the amount of lines that can be inserted from Business Central to Dataverse?
Is there a way to check if records are still being inserted into Dataverse?
Can you fully stop the Synchronization process? I had a problem with duplicate insertion when Full synchronization is clicked twice.

Thank you in advance

  • Suggested answer
    YUN ZHU Profile Picture
    YUN ZHU 73,565 Super User 2024 Season 2 on at
    RE: Data insert from Business Central to Dataverse

    Hi, Maybe the limitation is related to the following MS Docs.

    https://docs.microsoft.com/en-us/dynamics365/business-central/dev-itpro/administration/operational-limits-online#Reports

    pastedimage1648089368430v1.png

    We have submitted a Support Request to ask Microsoft to expand some settings before, for exampe, timeout. I don't know if this is still allowed, I think you can try to get in touch.

    Hope this info will help.

    Thanks.

    ZHU

  • Hein Kruger Profile Picture
    Hein Kruger 501 on at
    RE: Data insert from Business Central to Dataverse

    Hi  Nitin and Marco, 

    I looked in the Job Queue Entry as Nitin suggested and I found the process did error because the process took longer than 12:00. It automatically restarted after the first 12:00 hours and then stopped.

    Another user on another forum  advised to rather do 50,000 rows at a time and run three jobs  with the scheduler. This improves the insert time but leaves the user to check if the jobs have completed. is there maybe another method to insert 700,000+ records without doing 50,000 at a time?
    Maybe up the time out to 72 hours?  


  • Suggested answer
    Nitin Verma Profile Picture
    Nitin Verma 21,091 Super User 2024 Season 1 on at
    RE: Data insert from Business Central to Dataverse

    Hi Hein,

    Yes you can view what is being synchronized, by going to the JOB queue, you can start stop any time, everytime when you start synchronize, a job queue entry creates and delete it self when synchronize done.

    Just go to the job queue entry and try to find which one is "In-Process" state

    Thanks.

  • Suggested answer
    Marco Mels Profile Picture
    Marco Mels on at
    RE: Data insert from Business Central to Dataverse

    Hello,

    Did the job queues time out and maybe do a couple of synchs where you do the synchronization in batches using filters may help?

    Thanks.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Community AMA December 12th

Join us as we continue to demystify the Dynamics 365 Contact Center

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,253 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,188 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans