Export DataEntities to BYODB

(0) Share

Report

Posted on by MB-05091058-0

Ciao,
I'm working to export DataEntities for my BYODB (SQL Azure) and I would like to export by default all entities in incremental mode. I don't know if there will be any issue with transactional DataEntities like InventTrans or Purchline/salesline etc... in term of performance...My thinking is to export all DataEntities in incremental mode where possible... full if not possible in incremental and use a filter on DataEntities (for example the creation date greater than the start of the current year) in order to limit the range of data to export. Do you think this is a good approach or is it better to choose full build as default method of exporting?
Any suggestion is welcome

All responses (5)

Answers (1)

MB-05091058-0 65 on at

Like (0)

Report

RE: Export DataEntities to BYODB

Hi Tracy,

thank you for your answer. I read the article and it's ok for me. I have only a problem... i don't know the correct procedure to republish a dataentity in Byod... I mean...

I Have a dataentity with change tracker enabled and in Byod is ok... I make an update (for example I add a new field in DE) ... the steps that i do are:

1) remove the dataentity from the batch job

2) disable the change tracker on the dataentity

3) drop entity (this step remove the staging table in the Byod)

4) publish the dataentity (the staging table is create in the byod)

5) enable the change tracker in the dataentity

6) add the dataentity in the batch job with incrememtal push

the problem is that now the batch export only the record update after enable the change tracker and not run the full push to recreate all the record in the destination (like the first time)... I don't know how to recreate the byod align to d365 (all record in the staging). I think it is necessary a manual full push before to re-set an incremental push...is my think correct?.... is there a article about this issue?

Thank you

Ciao

Michele
Verified answer

TracyXing on at

Like (1)

Report

RE: Export DataEntities to BYODB

Please refer to docs.microsoft.com/.../export-entities-to-your-own-database, for incremental push, whenever a new record is inserted, or a record is added or deleted, the corresponding change will be reflected in the destination entity. We recommend that you first enable change tracking and schedule a export job with incremental push. This will take care of the first full push and the subsequent incremental exports.
Suggested answer

André Arnaud de Cal... 291,391 Super User 2024 Season 2 on at

Like (0)

Report

RE: Export DataEntities to BYODB

HI Michele,

The incremental approach is recommended and faster compared to a full table export. If you go for the incremental option, there will be a SQL trigger activated. This knows exactly which records were changed or added.
MB-05091058-0 65 on at

Like (0)

Report

RE: Export DataEntities to BYODB

Hi Andrè,

not all entities...but the most important (we have create custom dataentites based on the standard table of d365 with the only necessary data) in order to create reporting purposes. Now we export purch data, sales data, inventdim and inventtrans (and other linked to these).... but the issue is understand if the incremental export is better than full export when the data will increase (and if the change tracking performance set in the inventtrans entity can reduce the performance of d365)... or if the time to check the difference between D365 and Byodb is better than truncate the staging table before D365 do full export.

thank you for your feedback

Ciao

Michele
Suggested answer

André Arnaud de Cal... 291,391 Super User 2024 Season 2 on at

Like (0)

Report

RE: Export DataEntities to BYODB

Hi Michele,

Do you really need to export all entities? For what reason? The cost for Azure SQL might become too high. I would focus on only the data which is required to have in a BYOD for e.g. reporting purposes.