Skip to main content

Notifications

Announcements

No record found.

News and Announcements icon
Community site session details

Community site session details

Session Id :
Dynamics 365 Community / Forums / Finance forum / BYOD Export large amou...
Finance forum

BYOD Export large amount of data

(0) ShareShare
ReportReport
Posted on by Mpaga 25

Hi,
I have some problems with BYOD export.
It:
- always fails for exports with a lot of data (more than 40 million records for the biggest entity)
- sometimes fails for exports with roughly 3 million records
- always works with small records entities
we are talking about transactional and we are using incremental push.

The BYOD Sql Azure Database is a single DB P1 (high performance I think).
The D365FO test enviroment is based on a tier 1 (here it is where we are doing our tests and maybe it's not enough).

Monitoring the Sql in the tier1 machine, we can see the export query in processing but suddenly, after 80 minutes or something like that, it disappear.
Do you have any useful information and advice? Is this problem just because of the tier1 machine?

Thank you very much.

Categories:
Data Integration
Development / Customization / SDK
  • Ljungan80 Profile Picture
    Ljungan80 15 on at
    RE: BYOD Export large amount of data

    Just found out that the entity that is causing time outs is up for a review. Most likely something wrong with the SQL syntax. I just have to wait and see. Thanks for your feedback!

  • Mpaga Profile Picture
    Mpaga 25 on at
    RE: BYOD Export large amount of data

    Does it happen in a non-production environment or is it just in prod?

    Anyway, you should raise a ticket to Microsoft to know if there are issues or sizing evaluation was wrong.

  • Ljungan80 Profile Picture
    Ljungan80 15 on at
    RE: BYOD Export large amount of data

    Thanks for the info. We are currently running four AOS servers in prod with an extensive list of batch jobs, around 200 including byod jobs. Everything is slow and we often get timeout when pushing and fetching data into the system. Not sure if our environments can be compared but any tips on settings that boost the performance is appreciated. Microsoft is hosting it for us so we have no insight into the hardware setup.

  • Suggested answer
    Sheikh Sohail Profile Picture
    Sheikh Sohail 6,125 on at
    RE: BYOD Export large amount of data

    DTU of SQL Azure DB... its combination of system infrastructure.

  • Mpaga Profile Picture
    Mpaga 25 on at
    RE: BYOD Export large amount of data

    Hi,

    we didn't raise a ticket because in new D365FO versions (like 8.1 and 10) there is a setup in Data Management where you can increase the timeout by yourself.

    Talking about DTU we meant the BYOD Sql Azure DTU and not the D365FO.

  • Ljungan80 Profile Picture
    Ljungan80 15 on at
    RE: BYOD Export large amount of data

    Hi, have you gotten microsoft so raise the DTU for the production environment ever? 

  • Suggested answer
    Sheikh Sohail Profile Picture
    Sheikh Sohail 6,125 on at
    RE: BYOD Export large amount of data

    Our team learned from our last 3 Implementation. where we faced lots of issue of performance have enough learning exp with Microsoft especially in BYOD :) 

  • Mpaga Profile Picture
    Mpaga 25 on at
    RE: BYOD Export large amount of data

    Hi Sohail,

    thank you for the advise. How do you know that the minimum DTU recommedation is between 400 and 800?

    Is there a document or you just learned it from your experience?

    If there is a document, could you please share the link?

    Thanks

  • Suggested answer
    Sheikh Sohail Profile Picture
    Sheikh Sohail 6,125 on at
    RE: BYOD Export large amount of data

    Hi Mpaga,

    125 DTU are too low, Minimum recommendation of DTU between 400 to 800, currently we are running 2500 DTU

  • Mpaga Profile Picture
    Mpaga 25 on at
    RE: BYOD Export large amount of data

    Hi Sohail,

    we tried to raise the DTU of the Sql Azure (the BYOD destination database) from 125 to 250 and it works.

    Do you think there's something we can do to have a succesfull export but keeping DTU at 125?

    Thanks.

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

November Spotlight Star - Khushbu Rajvi

Congratulations to a top community star!

Forum Structure Changes Coming on 11/8!

In our never-ending quest to help the Dynamics 365 Community members get answers faster …

Dynamics 365 Community Platform update – Oct 28

Welcome to the next edition of the Community Platform Update. This is a status …

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 292,884 Super User 2025 Season 1

#2
Martin Dráb Profile Picture

Martin Dráb 231,760 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156 Moderator

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans