Skip to main content

Notifications

Announcements

No record found.

Customer experience | Sales, Customer Insights,...
Answered

How to export matches

Posted on by 5

Hi all,

When executing the unification process in Customer Insights, the matching step shows the results of the matches like in the image below.

We want to export the results for thorough analyses.

 

However, it only exports the first 100 results. Is there a way to export all the results?

We want to use it to apply de-duplication in our sources.

 

Hope you can help! Thank you!


Best Regards, 

pastedimage1610021246232v1.png

  • Fortuna2518 Profile Picture
    Fortuna2518 15 on at
    RE: How to export matches

    Facing same issue let me know if you find any solution for this

  • Fortuna2518 Profile Picture
    Fortuna2518 15 on at
    RE: How to export matches

    Thanks for the information

  • John Wiese Profile Picture
    John Wiese on at
    RE: How to export matches

    For prediction results we will be shipping an update soon that will allow you to export the entity to Blob storage.

  • tpeschat Profile Picture
    tpeschat 4,926 on at
    RE: How to export matches

    Hi,

    actually the application is quite chatty and you can see the requests in the network traffic.

    This is the request, when you download the 100K conflation match pairs from the entities:

    pastedimage1611603136571v1.png

    You can do the same via Swagger (you have the whole API definition there):

    https://prod-weu-01.api.ci.ai.dynamics.com/swagger/index.html

    You should exchange prod-weu-01, if your instance isn't hosted in western europe, though.

    Before you can try out a request, you need to authorize:

    pastedimage1611603263644v2.png

    Then locate the "EntityData" and perform a GET request, where you provide your instanceid and in the relative path fill in ConflationMatchPairs?$select=*&$top=100000.

    pastedimage1611603492133v3.png

    You could try to leave out the $top=100000, or try out other values.

    You can download the response as a json, but it is paginated, so you only get 100 records per page ...

    So also not an easy, user friendly option. The export might be easier in that case ...

    br Thomas

  • Sivaraman Sekar Profile Picture
    Sivaraman Sekar 20 on at
    RE: How to export matches

    hi,

    we tried hitting that api to get predicted data from entity. we not able to export what we required, instead we got only count values and other meta data's. is there any other way to pull those values

    Thanks,

    Siva

  • Community Member Profile Picture
    Community Member Microsoft Employee on at
    RE: How to export matches

    Hi Marijn,

    The suggestions of Fabio and Thomas are correct.

    If you have > 100k records in your match procedure, you won't be able to extract them all via the CI interface.

    And unless you export to a destination like Blob or SFTP, I'm not sure there are many other options.

    What you could try is access it via the CI API (GET https://api.ci.ai.dynamics.com/v1/instances/<instanceid>/data/ConflationMatchPairs) .

    You can access the CI API documentation in CI itself (Admin > Permissions > APIs > Explore our APIs).

    I've done this before using Postman but I have never gone as far as saving the data and checking if all the records are there.

    For practical purposes you'd probably want to save the response as a table or dataframe for analysis so consider using Python and Pandas to do this.

    Good luck!

    Halen

  • RE: How to export matches

    Thanks for the suggestion, but i was looking for something more simple. This is a quite comprehensive solution.

    I was looking for something more simple, directly in the step where I am doing the matching. Just like you can download directly form the overview there the 100 results to Excel. But apparently there's no other way.

    Still thanks!

  • Verified answer
    tpeschat Profile Picture
    tpeschat 4,926 on at
    RE: How to export matches

    Hi,

    yes this should be possible.

    If you navigate to Data --> Entities you can find a system entity called ConflationMatchPairs.

    If you want to export the whole entity and not only the first 100K results, you can define a new export destination at Admin --> Export destination.

    There you can define a new export to either an azure storage account or an SFTP location and choose which entities to export.

  • Fabio Branco Profile Picture
    Fabio Branco on at
    RE: How to export matches

    Hi Marijn,

    Thank you for your question

    I am not aware if it's possible to export +100 matches

    Allow me to so some research and come back to you later on this topic

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Top 10 leaders for November!

Congratulations to our November super stars!

Tips for Writing Effective Suggested Answers

Best practices for providing successful forum answers ✍️

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,280 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,214 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans