Hi All,
We have a requirement where data is imported into a custom table in D365 F&O using a DMF project triggered from Azure Data Factory (ADF).
The issue is that when some records fail validation, the DMF execution status becomes Partially Succeeded. For example, if a file contains 36 records and 3 records fail, the remaining 33 records are successfully imported into both the staging table and the target custom table.
In our scenario, the combination of:
FileName (from the CSV file)
LineNumber (auto-generated by DMF)
is used as the entity key.
The ADF team would prefer an all-success or all-fail approach. Their current plan is to treat any DMF execution status other than Succeeded as an error and trigger an email notification.
However, from the D365 F&O side, we would like to know whether there is any way to prevent partial processing and ensure that:
Either all records are imported successfully, or
No records are committed to the target table if any record fails.
Has anyone implemented a similar requirement? Are there any standard DMF settings, customizations, staging validation approaches, or transaction handling techniques that can help achieve this behavior?
Any suggestions or best practices would be greatly appreciated.
Thanks and Regards,
Raj D. Borad