D365FO Archiving and BI Strategy

(0) Share

Report

Posted on by Community Member

Hi,

I cannot find any Microsoft D365FO Transactional Database "Archiving" Strategy that is compatible with BYOD and PowerBI. What's Microsoft recommendation? Can someone help please?

Attached a concept diagram

Categories:

Other

I have the same question (0)

All responses (8)

Answers (1)

Sort by

Suggested answer

nmaenpaa 101,172 Moderator on at

Like (0)

Report
Copy link

Link copied!

You can export the prod DB to test system, and from there you can bring it anywhere you like. So that would match the bottom left of your picture.

However you can't remove old posted transactions from your system (for example older than x years).

You can also copy your BYODB database and archive the copy.

But why would you need it?

Same question about BYODB, why would you need two of them?

What business requirement are you trying to resolve?

Was this reply helpful? Yes No
Verified answer

Sukrut Parab 71,739 Moderator on at

Like (0)

Report
Copy link

Link copied!

There were some archiving tools for old versions , not sure about D365FO though . The approach Microsoft suggest when you go on D365 cloud version is to go with required data for example , open transactions , master data etc. Archiving strategy is needed when you have lot of data , which was case I have seen at few customers where they have DB size in terabytes.

If you have not implemented /implementing D365 FO suggestion is to archive data in your old system. Also in your diagram, you don't need two BYODB . If you have Archive DB you can directly use that for reporting.

Was this reply helpful? Yes No
Community Member on at

Like (0)

Report
Copy link

Link copied!

Thanks for your reply Nikolaos,

Why we cannot remove old posted transactions from the system? is that a system limitation?.

I cannot see a reason to "archive" a copy from Production environment, for that Microsoft offer backups and replication technology to facilitate Disaster Recovery if needed to secondary hosts/data centre.

We are planning our initial D365FO Implementation and we have some doubts related to system performance. We are expecting the DB to grow rapidly due to the high number of business units, sites and countries running over the same PROD environment. We are expecting a huge number of internal transactions and with many 3rd party companies.

There is a concern that the (cloud based) PROD environment response performance could be slow if posted transactions are not archived into a "read-only" archived environment after for example 2 years. The idea is to keep the PROD database as slim as possible to boost response time. As we need the archive transactions for PowerBI, the idea is to move both DBs using BYOD and then configure PowerBI to read from both reporting environments. In doing that we keep the PROD environment not only slim but also isolated from PowerBI. As I said the idea is to get the best Performance possible.

Maybe we do not need two BYOD (as Sukrut Parab suggest) only one as per below new image

We have no enough experience with D365FO architecture and we want to understand. If archiving is not needed we want to know why and how Microsoft is going to ensure the performance is not dropping dramatically after the DBs start growing.

Was this reply helpful? Yes No
Community Member on at

Like (0)

Report
Copy link

Link copied!

Thanks Sukrut, can you see my previous reply to you both please?

Was this reply helpful? Yes No
Suggested answer

nmaenpaa 101,172 Moderator on at

Like (0)

Report
Copy link

Link copied!

Yes, not being able to delete posted transactions is a feature of Dynamics AX and Dynamics 365 for Finance and Operations. Posted transactions mean data such as invoices, and ledger entries.

Once something is posted, you can't change it anymore.

In AX2012 Microsoft created a tool called Intelligent Data Management Framework (IDMF) which you could use to clean up such posted transactions, by combining old transactions to summary transactions. But this tool is not available for D365FO.

The most important thing is to have a good clean up strategy for all log, history, and worksheet data. You can clean up batch history, integration staging tables, journals etc.

I'd also like to say that usually large amounts of data doesn't mean bad performance. Normally performance bottlenecks are related to large amount or volume of ongoing transactions, but any cleanup don't have impact on this.

Was this reply helpful? Yes No
Suggested answer

Sukrut Parab 71,739 Moderator on at

Like (0)

Report
Copy link

Link copied!

When you say database size is going to increase rapidly , how big is database going to be you think ? What's the size of database In your current system .

Deleting transactions is not possible in cloud version . The reason I asked you about DB size is because , one of our customer we upgraded from AX 2012 with all the data(Ax 2012 system had all the data from their legacy system) , customer is using D365 FnO from last 2+ years and we haven't encounter any major performance issues. if you see any issues there are tools to help you like telemetry in LCS , which has bunch of functionality added and its still improving. Keeping database slim doing doesn't mean you are not going to encounter performance issues.

Was this reply helpful? Yes No
Community Member on at

Like (0)

Report
Copy link

Link copied!

Looks like Archiving is not needed and that the Key is a good Monitoring Strategy.

Cheers and thanks.

Was this reply helpful? Yes No
Sukrut Parab 71,739 Moderator on at

Like (0)

Report
Copy link

Link copied!

Great . If any of above answer helped you close the thread by marking answers verified.

Was this reply helpful? Yes No