Skip to main content
Dynamics 365 general forum

Issues with duplicate detection

editSubscribe (0) ShareShare
Posted on by 80

I am trying to set up a robust proactive process for duplicate contacts.

In Dynamics we have 2 rules based on email address and the other on mobile phone.  If I run this against active contacts then I fine 14 duplicates.

I also have a C# application which uses the BulkDetectDuplicatesRequest.  For that I am supplying the email address rule only and I am receiving 55 duplicates.

When I open each record in turn from the 55 records.  Some of them will pop up the Merge dialog while others do not.

Finally, thought I had a choice of solutions for sending an email that I could present: OTB or my Console App.

However when I showed the results, someone was able to show be an email address that had 15 duplicate copies.  Thus I suspect there are loads of duplicates rather than the small number I am finding vie the two methods above.

Is the functionality broken? Or am I missing something in my approach?

As I recall, there is some weird index thing that is generated in the back end.  Maybe this is wrong, stalled, broken, not covering all Contact records???

Any advice?

  • Kristina_Skyline Profile Picture
    Kristina_Skyline 90 on at
    RE: Issues with duplicate detection


    You should take a look at a new user-friendly De-Dupe solution published on AppSource! Depending on your need it allows you to set up duplicate detection rules using standard Dynamics 365 functionality, but to review and merge duplicates in a completely renewed and comfy interface.

    No more old, user-incomprehensible list of duplicates repeating with each merging step. Plus, since it has just been launched on AppSource, the solution is FREE of charge and includes support.

    Feel free to visit Skyline Consultants website for more details



  • GordonJohnston Profile Picture
    GordonJohnston 80 on at
    RE: Issues with duplicate detection

    Getting more results from my code today.  I wonder if there was some indexing going on in the background because one of the rules changed yesterday.

    I can see the record I am expecting in the list now.  It is there twice and I guess I will be able to merge them together and then into the other 15 (likely that will be by hand anyway).  Possible there are 2 because there are 2 contact rules?!

    So my total will NOT be the total duplicates but the de-duped total of unique duplicates (hope that makes sense for the next person).  Would like to get the full total as well so will research that.

  • Nya Profile Picture
    Nya 29,043 on at
    RE: Issues with duplicate detection


    I look forward to hearing from you about your test results and if there is still a problem, please don't hesitate to let me know!

  • GordonJohnston Profile Picture
    GordonJohnston 80 on at
    RE: Issues with duplicate detection

    Just found that the OTB interface shows 1-12 but there are more pages so I think this is working fine.  Pain that it isn't more clear in showing the total.  Maybe my code is returning a limited data set as well.  Will get to the bottom of it.

  • GordonJohnston Profile Picture
    GordonJohnston 80 on at
    RE: Issues with duplicate detection

    That is useful to know.  

    So the duplicate total and the results from code represent only the top box and do not include all the other records that they are matching.

    Good to know.

    However, with the 15 duplicates that I mentioned.  Not a single one of them are included in either the OTB results or my code.

    All 15 records are active but I am not getting one of them reported in my total for some reason.

    I am going to double-check my code this morning.  Maybe I missed it.

  • Verified answer
    Nya Profile Picture
    Nya 29,043 on at
    RE: Issues with duplicate detection


    I assume that the 15 duplicate copies you are referring to are the effect shown below, right?


    If yes, this pop-up screen will list all records that are duplicates of that record.

    As an example, when saving A it shows duplicates with B, C and D. When saving B, it will also list A, C and D.

    So the total number of duplicate records is not the sum of the duplicate records shown for each one, where there will be an overlap.

Helpful resources

Quick Links

What Motivates a Super User?

We know many of you visit the Dynamics 365 Community and Power Platform…

Demystifying Copilot with Georg Glantschnig…

Industry experts answer burning questions directly from our amazing Community…

Setting Up Knowledge Sources for Copilot…

Look at how configuring a comprehensive knowledge base is crucial…


Andre Arnaud de Calavon Profile Picture

Andre Arnaud de Cal... 283,066 Super User

Martin Dráb Profile Picture

Martin Dráb 222,585 Super User

nmaenpaa Profile Picture

nmaenpaa 101,138

Product updates

Dynamics 365 release plans