How to export fields defined in custom data entity ?

(0) Share

Report

Posted on by Ken Manhattan

552

Hi,

I have created a custom data entity which contain 2 tables, primary table is InventModelGroup then it will have relation to EcoResReleasedProductV2 entity like below:

After pulling all the necessary fields, the deployment is succeeded. I can get what I wants, and checked in SSMS, it is correct.

But through Data Management, as I tried to export it, turns out I only have field with those from primary table InventModelGroup only.

Anything missing from the data entity creation ?

I have refresh Data Entity from Data Management Framework.

Thanks.

I have the same question (0)

All responses (7)

Answers (2)

Suggested answer

Komi Siabi 13,099 Most Valuable Professional on at

Like (1)

Report

Hello Ken,

Can you confirm that these fields are available on the staging table as well.

Was this reply helpful? Yes No
Ken Manhattan 552 on at

Like (0)

Report

Hi Komi,

After checking, it is not, and I can't just add those field by copy paste from my Data entity, can't I ?

Btw there is another thing I just realized after you've mentioned about the staging. Is that the staging index is combination of DefinitionGroup+ExecutionId+ModelGroupId and it set to No Duplicates. But since it is inner joint to EcoResReleasedProduct, and I want to include fields from that entity as well, I'm pretty sure the index will not satisified uniqueness.

Is there a special way to create staging ? Btw when I export via Data Management I choose to skip staging because I thought I do not need that, as I simply want to export. This Data Entity is not meant for Import.

Thanks.

Was this reply helpful? Yes No
Verified answer

Martin Dráb 237,855 Most Valuable Professional on at

Like (1)

Report

You can't copy fields from the entity, but you can open your entity in design, right-click its name and choose Update Staging Table.

What should be in the staging index depends on the entity key. First make sure you have the entity right. Then - if needed - change the staging table index and the relation between the staging table and the entity. (You may want to generate the staging table in such a case.)

Was this reply helpful? Yes No
Ken Manhattan 552 on at

Like (0)

Report

Thanks, it works.

May I know what is the purpose of this staging table, in relates that I intended to use this custom Data Entity for export only (and will be use for OData - get method). Initially, my understanding is that staging table needed when we want to Import. As I notice in Data Project - Export, when we want to add entity, it already defaulted to "Skip staging" ->

Btw, after deployment to Tier-2 environment, it took me several time to Refresh Entity List, then go to Data Entity list and looking at the additional fields to show up. I tried to Generate mapping few time as well to make it shows in its mapping list.

Thanks.

Was this reply helpful? Yes No
Verified answer

Layan Jwei 8,097 Super User 2025 Season 2 on at

Like (1)

Report

Hi Ken,

If the flag is false, when you export, data is exported to a staging table before it gets transferred to a file format. You will need it as false, if you have virtual field or if you use postLoad method or if ur entity is composite.

If the flag is true, it helps you in improving the export performance because you skip the part when to export data to staging table.

So keep it as true.

In my experience, Refresh entity list takes about 15-20 minutes. When you click the refresh button, if you go to "Data entities" tile in DMF, you'll get an info message that it is running. When u refresh and the message goes, it means it finished, then you can generate mapping if needed

Thanks,

Layan Jweihan

Please mark this answer as "Verified" if it solved your issue. In order to help others who will face a similar issue in the future. You can do this by ticking the box "Does this answer your question"

Was this reply helpful? Yes No
Ken Manhattan 552 on at

Like (0)

Report

Thanks for your kind explanation.

We can closed this thread as solved. I would like to check all the responses, however need help from admin to do this.

Thanks a lot guys.

Was this reply helpful? Yes No
Layan Jwei 8,097 Super User 2025 Season 2 on at

Like (0)

Report

Hi Ken,

What are the answers you would like to verify? The three answers?

Was this reply helpful? Yes No