Skip to main content

Notifications

Finance | Project Operations, Human Resources, ...
Suggested answer

DIXF not working as expected when running a process in batch

(0) ShareShare
ReportReport
Posted on by 5

Hi,

I'm currently working on an automation process that is initially started by SysOperation Framework. Within this process, I am using the standard method DMFEntityBase::addEntityForProcessingV3 to create projects and import data packages by making use of filestreams.

When the process is launched as Synchronous (specified in the controller of the SysOperation Framework), everything is fine. However, this process is quite long and it also locks the use of the environment which goes against the aim of this project. When run in Asynchronous, the outcome is very random - sometimes packages stall, sometimes it runs without errors and sometimes it doesn't even run at all. When run in ReliableAsynchronous, it's very similar to Asynchronous but the process keeps going when the session is interrupted, and so if a package stalls, this keeps going indefinitely. This led to running the entire process in batch.

When run as a batch job - the process goes through without any errors showing. However, when looking through all the data packages imported in the data management workspace, all of the data is imported in the staging table but not the target table (Status is "Didn't Run" in execution log). If I click "Copy data to Target" everything works without errors. This does not happen with the other methods mentioned in the previous paragraph (Synchronous, Asynchronous & ReliableAsynchronous). What I am finding strange is that when this process is run in batch, "Copy data to Target" seems like is being skipped. There also aren't any errors as when I click "Copy data to Target" without changing anything, it works as normal.

Is there a reason why this is happening?

Thanks

  • Etienne Caruana Profile Picture
    Etienne Caruana 5 on at
    RE: DIXF not working as expected when running a process in batch

    Here's a code snippet of the code in question:

    if(stream)
            {
                //Temporarily upload the stream to get the file ID. This is used in the creation of the DIXF project referred to as the sample file ID
                SysDictClass uploadStrategyDictClass = new SysDictClass(className2Id('FileUploadTemporaryStorageStrategy'));
                FileUploadTemporaryStorageStrategy fileUploadStrategy = uploadStrategyDictClass.makeObject() as FileUploadTemporaryStorageStrategy;
     
                FileUploadTemporaryStorageResult result = fileUploadStrategy.uploadFile(stream, fileName);
     
                SharedServiceUnitFileID  SharedServiceUnitFileID = result.getFileId();
     
                DMFEntityBase::addEntityForProcessingV3(dmfDefinitionGroupName,
                                                groupDescription,
                                                ",
                                                dmfDataSource.SourceName,
                                                SharedServiceUnitFileID, //Sample File ID
                                                "@SYS6047,
                                                NoYes::No, //Skip Staging
                                                NoYes::No, //No = Import, Yes = Export
                                                "",
                                                NoYes::No,
                                                DMFRefreshType::FullPush);
     
                //Setting up an execution Id to link the DIXF Project to an execution
                DMFExecutionId executionId = DMFUtil::setupNewExecution(dmfDefinitionGroupName);
     
                //Begin the execution on the DIXF Project
                DMFQuickImportExport::doPGImport(dmfDefinitionGroupName, executionId, true, true);
     
                //Delete the Temporary storage variable
                result.deleteResult();
            }
    This is showing status of Staging Table as "Ended" and Target as "Didn't Run". We have also tried the following and both Staging and Target are showing as "Didn't Run":
    DMFUtil::executeDataProjectImport(dmfDefinitionGroupName, executionId, truefalsefalse); 
     
  • Suggested answer
    huijij Profile Picture
    huijij 19,811 on at
    RE: DIXF not working as expected when running a process in batch

    Hi Etienne,

    Because this issue requires further investigation, you are advised to create a support ticket for professional assistance following the below procedure.

    admin.powerplatform.microsoft.com/support

    Best Regards,

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing Our 2025 Season 1 Super Users!

A new season of Super Users has arrived, and we are so grateful for the daily…

Vahid Ghafarpour – Community Spotlight

We are excited to recognize Vahid Ghafarpour as our February 2025 Community…

Congratulations to the January Top 10 leaders!

Check out the January community rock stars...

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 292,160 Super User 2025 Season 1

#2
Martin Dráb Profile Picture

Martin Dráb 230,962 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Product updates

Dynamics 365 release plans