We're switching from BYOD to Datalake. Most everything has been exported fine, except one:
ProjectStaging - which here you can say has 'sortingid1', 'sortingid2', 'sortingid3'
In exporting to BYOD, I see it here
And OK:
Staging Table: ProjectStaging = Entity: Projects.
Seemingly 'entity' is the name I want, to translate over to the Datalake Export screen.
Go over to Export to Datalake, there are several Entities named 'Project'. I assume ProjectEntity is probably the one I'd want
I do see, in our storage account, a definition for ProjectEntity in Entities/ProfessionalServices/ProjectManagementAndAccounting
But that definition is missing SortingColumn1, SortingColumn2, etc.
I am doing this by feel - which has worked mostly, but not on this one. I'm not clear if I'm grabbing the wrong entity, or if the entity is correct, but is (somehow) exporting with some of the definition missing / what to troubleshoot.
Since data entity itself is used in BYOD so virtual fields will be exported. For Azure Data Lake, you can create table fields and add logic before insert to populate those fields. Also have to run script to populate data for existing records. I couldn't find any way that MS recommends to handle virtual and computed fields in azure Data Lake.
Thanks! The SortingColumn1 & SortingColumn2 did successfully export to ProjectStaging in our BYOD
Not so sure then, how can we recreate ProjectStaging (with those virtual fields) in the Datalake Export?
Hi, ProjectEntity is the correct data entity and SortingColumn1, SortingColumn2 are Virtual fields in Data entity. When we select Data entity from 'Choose using entities' all underlaying tables are exposed. But since this fields are not mapped fields with DataSource table, I think that's why its not exposed.
I did just notice.
One folder down
Entities/ProfessionalServices/ProjectManagementAndAccounting/resolved
There's a second projectentity.cdm.json file
And this one has additional lines that do mention SortingID1, etc.
Though idk what this means -
André Arnaud de Cal...
291,971
Super User 2025 Season 1
Martin Dráb
230,846
Most Valuable Professional
nmaenpaa
101,156