Hi, I have been trying to unify two data sources in D365 Customer Insight, however data from one sources is not loading at all. Please see the attached image. The data from main sources is not coming at all. Contact is the main source and minicontact is just duplicated contacts with fewer fields (generated to merge data as a second source). Data from minicontact is coming but not from the main source (contact).
When I take contact data in Power BI with CI connector, everything looks fine.
When I generated the customer profile, there is no field values as we see in the image below. The whole process ran smoothly and there is no error on any entity when I checked in data and then in entities.
I can not figure out where is the issue at all.
Has anybody got problem like this ?
Any idea/suggestion is much appreciated.
Thanks,
Mahesh
Thanks Bill. Here are some of the list of characters that I have found (contains all sort of characters). I found one video (https://www.youtube.com/watch?v=N-0JrYQB0Ag
) demonstrating List.Accumulate function, which I find quite interesting and I am testing it and seems to work, better than replacing character one by one.
Yes, Please let me know, if you find some documents regarding special characters that PQ find difficult to handle.
Yah, something's wrong. I would have expected clean to grab it but I believe the problem generally comes from them causing problems with Spark when they're being written. The usual culprits I know of are " ,;{}()\n\t=", it's ugly but you might be able to make a pass and replace them again using PQ but I know that's lame. I saw Badge mention the Dates, I've had that happen quite a bit too - each time I've used the Dataverse connector, I've run into problems. The interesting thing is that the logs will indicate it's a date formatting issue (but in these cases the dates were created by Dynamics so that seemed unlikely) - what it turned out to be was control characters in an adjacent or preceding column, that caused drift so the values in the date columns were incorrect when you counted based on delimitter.
Probably best bet is trying to isolate those fields and use PQ for now, I'll see if I can find a more comprehensive list of all of them that can cause the problem. If you do happen to find the record's - if you can paste the original value it'd be cool. I want to try to write out a file in spark and see what it ends up converting to.
No-Character-but-length-exists.xlsx
Thanks Bill. I did used trim/clean function. I found some characters in CRM that I can not see. Please see the attached sample file. In cell A3 and A4, there is no character but when I checked the length, it shows 3. One seems to be the space, but there are other two hidden characters. So I would expect that might be the major cause of problem.
I think the safest way to handle it (assuming Power Query) is to select all the rows, choose Transform Text and then Clean. I think it's mainly carriage returns/line feeds but any control characters can be a problem, tabs for instance.
Thanks Badge. Yes, I did find special characters in my data, which I think that is causing the issue. In fact, I needed to reset whole environment to work it again. It seems that the environment was corrupted because of data corruption. I do want to find what are the characters that are permitted, but have not been find that information yet.
Hi, I would first check to see if you have a corrupt entity for your D365 contact data. If there is, you can check the corruption reason against each row. I've had this issue before and was down to a date format corruption.
Mukesh, I do not see any option to select. The drop down menu is completely blank. I did try to select that blank space and send it, but it says, you need to select severity and force me to start from the beginning.
Do you see option for selecting severity or you need info on what severity to select?
Thanks @Bill, Mukesh
There is only one error on Data Preparation. Data sources refreshed successfully. Unfortunately, it does not give much information about the error. Please see the error below. @Mukesh, I tried to raise the ticket but I do not get any option for "Severity" of problem. With out that field, it does not allow me to create the ticket as that field is mandatory. Please see the error below.
Thanks both. When I set up the refresh from the admin--system--schedule, then I get the warning on data sources. It says "you have managed those data sources and it refresh on your scheduled time). But when I refresh data sources manually, everything runs perfectly fine.
Now, when I go to Admin--System--and status Data source refreshing is fine. There is problem with Data Preparation.
Power Platform seems to be fine. In Power Platform, there is contacts, that I can not delete. It says something wrong, try again later. I had previously created this data sources and deleted. However, it seems its still there. Is this causing the issue?
Stay up to date on forum activity by subscribing. You can also customize your in-app and email Notification settings across all subscriptions.
André Arnaud de Cal... 291,253 Super User 2024 Season 2
Martin Dráb 230,188 Most Valuable Professional
nmaenpaa 101,156