Finance | Project Operations, Human Resources, ...

How to customize DMF to get error from bulk copy to staging table

(0) Share

Report

Posted on by Community Member

HI We are using DMF for mass data migration from CE to F&O, but the import job fails and there is no data in staging table and no error at all. We know it's data issue but it's hard to detect when the data set is so huge.

Is there anyway I can customize DMF so I can get error out when it's bulk copy the source to staging?

Thanks very much!

I have the same question (0)

All responses (5)

Answers (0)

Suggested answer

Ramit Paul 22,797 Most Valuable Professional on at

Like (0)

Report

Hi,

If there is no log in staging table, kindly check in view execution log, from there you will get info log, staging log details and view error files.

Was this reply helpful? Yes No
Gunjan Bhattachayya 35,423 on at

Like (0)

Report

Hi Yvone,

I don't think you can get this error out. Could you please tell us which entity you are using for import? Is it OOB or customized?

Was this reply helpful? Yes No
Suggested answer

Sergei Minozhenko 23,093 on at

Like (0)

Report

Hi Yvonne,

If you don't see data in staging, you need to check the execution log and staging log details.

If data entities fail (shown with a red x or yellow triangle icon on the data entity tile) after you click Import, and View staging data shows no data, go back to the Execution summary page. Go to View execution log, select the data entity, and review the Log text, Staging log details, and Infolog for more information. Staging log details will display Error column (field) details and Log description will describe errors in detail.

https://docs.microsoft.com/en-us/dynamics365/fin-ops-core/dev-itpro/data-entities/data-entities-data-packages#import-process-troubleshooting

Have you considered to chop data sets into smaller pieces? Sometimes is easier to identify the issue.

Was this reply helpful? Yes No
Suggested answer

A.Prasanna 8,223 on at

Like (0)

Report

Hi Yvonne

I don't think you need customizations, we had a similar issue when finding DMF errors because data volume is high. the main issue is we cannot view errors as a list & need to browse through one at a time, there are three tables you can look in to,

1.DMFStagingValidationLog

2.DMFDefinitionGroupExecutionHistory

3.DMFDefinitionGroupExecution

Just open using Table Browser and Filter Data Project or Entity Name as relevant.

Hope this will help,

Amith Prasanna

Was this reply helpful? Yes No
André Arnaud de Cal... 301,075 Super User 2025 Season 2 on at

Like (0)

Report

Hi Yvonne,

You have to go with one of the workarounds provided above. The source to staging process is handled by a package executed by SSIS. So, in fact the SSIS job fails in case there is a mismatch in data format, missing mandatory field or duplicate record.

There is no way to customize the SSIS package or behavior.

Was this reply helpful? Yes No