DMF fail/error/rollback import job when on partial success

(1) Share

Report

Posted on by LR-16091108-0

Hi,

I am importing data using logic app integration calling OData REST API DMF import, which works great, but there is a new requirement to cancel whole job run, in case there is any error found in the run. Basically all-or-nothing approach for the import.

Is there any option how to do that?

Thanks in advance.

All responses (4)

Answers (0)

LR-16091108-0 4 on at

Like (0)

Report

DMF fail/error/rollback import job when on partial success

Hi Andre,

I understand what you are saying. Client's stand is basically that they want to have a set of data (file) which they can execute and they expect either full success or fail. In case of fail they will fix the data (process of fixing the data is complicated one and usually includes more senior client staff and could include multiple teams, because of data enrichment and pre-processing is done by different middleware teams), but if they insert some of the data from the file during the first run, fix the rest and try to run it again (yes, they can remove previously inserted data from the file, but that is not something what they want to do), it will now update previously created records which is also not something what they want (unless there is business reason for it) for later processing and data event's reasons to other 3rd party systems down the line.

Input file will be ad-hoc import of journal-like or account balance data usually consisting of thousands or tens of thousands of rows and the crux of the issue is that because there could be a significant time difference between data inserted during the first run and last (post fix) data, it could create inconsistences in the accounting for example, because different people are working on the import and outputs from it.

I hope that it makes sense, I understand that it is not a really standard solution, but any help or pointers are much appreciated.

Thanks.
André Arnaud de Cal... 294,127 Super User 2025 Season 1 on at

Like (0)

Report

DMF fail/error/rollback import job when on partial success

Hi Lukas,

Before suggesting options, we would need to learn more about your file. How many records do you expect to be in this file? Anyway, when something fails, and you would need to do a rollback of the full transaction, how would it be different for understanding the errors compared between a row-based and set-based transaction scope? Dynamics 365 F&O will return the same error anyway.
LR-16091108-0 4 on at

Like (0)

Report

DMF fail/error/rollback import job when on partial success

Hi Andre,

Thank you for your reply.

My scenario is a basically a input file from the user with data, which then goes under heavy data enrichment in the azure data factory and some other pre-processing in the logic app, before it is being sent to the D365 for the import. Since what is being sent in as the final product to the D365 is not exactly the input which user provided, my client fears that users will have issues trying to understand the errors why some records could have failed to be inserted/updated during the import so he would like to implement import job functionality as a singular transaction-like process.

I understand that it is not possible with the DMF, but are there any other options at all how to achieve this solution?

Many thanks.
André Arnaud de Cal... 294,127 Super User 2025 Season 1 on at

Like (0)

Report

DMF fail/error/rollback import job when on partial success

Hi Lukas,

This is not possible using DMF. When importing data via data management, data is processed row by row. In case there is an error and records got updated, the old values are not known anymore.

What is the exact scenario where this is asked?

Community site session details

DMF fail/error/rollback import job when on partial success

Helpful resources

News and Announcements

Quick Links

🌸 Community Spring Festival 2025 Challenge 🌸

Jonas ”Jones” Melgaard – Community Spotlight

Kudos to the March Top 10 Community Stars!

Leaderboard

Featured topics

Product updates

Community site session details

DMF fail/error/rollback import job when on partial success

Helpful resources

News and Announcements

Quick Links

🌸 Community Spring Festival 2025 Challenge 🌸

Jonas ”Jones” Melgaard – Community Spotlight

Kudos to the March Top 10 Community Stars!

Subscribe to this forum!

Select categories

Leaderboard

Featured topics

Product updates