Skip to main content

Notifications

Microsoft Dynamics CRM (Archived)

The best way to perform duplicate detection with a large number of leads?

Posted on by 985

I have about 10,000 leads in the CRM leads section already. I have 1,500 leads that are in a spreadsheet that I want to import in to the CRM.

The 1,500 leads in the spreadsheet are companies that were part of the 10,000 original import but this group of 1,500 have different bits of data on the company. Thus i want to import the 1,500 in to the CRM run a duplicate detection and merge the records, keeping the correct data from both records.

When I run a duplicate detection in the CRM it presents an error saying the following:   'Bulk Detect Duplicate Limit Exceeded. The Bulk Duplicate Detection job cannot detect more than 5000 duplicates. Please review your duplicate rules or resolve existing duplicates and rerun the job.'

Can I change this in order to scan for over 5000 duplicates? Because after the first 5000 scanned I have to do the others through filtering the 10,000 leads then merging them manually.

 Or is there a more efficient way to perform a duplicate detection of this nature altogether?

*This post is locked for comments

  • Inogic Profile Picture
    Inogic 24,088 on at
    The best way to perform duplicate detection with a large number of leads?
    Hi,
     
    Hi,
    I understand the challenge you're facing with duplicate detection in your CRM when dealing with a large number of leads. You can easily overcome the Bulk Duplicate Detection job limit of 5000 duplicates with deduplication solutions.

    One such solution that can simplify this task is DeDupeD App by Inogic.  DeDupeD can help you detect, prevent, and merge Duplicate records for any and all entities within the Dynamics 365 CRM. With the apps Clean Up History Duplicate Records in Bulk feature, users can detect and merge “N” numbers of duplicate records within Dynamics 365 CRM based on set criteria with just a click of a button.
    Here are some key benefits of using this feature:
    • Bulk Duplicate Merge: The Clean Up History Duplicate Records in Bulk feature allows you to run a comprehensive duplicate merge process, identifying and merging multiple duplicate records at once. This is particularly useful when dealing with a large number of leads.
    • Efficient Criteria-based Merging: You can set criteria for duplicate detection, ensuring that the correct data from both records is retained during the merge process. This helps maintain accuracy in your CRM data.
    • Convenience: The bulk merge process saves you from the hassle of manually going through each record and identifying duplicates. It's a more efficient way to clean up historical duplicate records.
    Be it 5,000 or 10,000 leads, DeDupeD can help you manage any number of duplicate leads within CRM.
    Download your free 15-day trial from the Inogic website or Microsoft AppSource to get started!
     
    Thanks!
  • Gus Gonzalez Profile Picture
    Gus Gonzalez 27,113 on at
    Re: The best way to perform duplicate detection with a large number of leads?

    Jonathan,

    Is it possible to export all these Leads to Excel, deduplicate in Excel and re-import the clean list?

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

December Spotlight Star - Muhammad Affan

Congratulations to a top community star!

Community AMA December 12th

Join us as we continue to demystify the Dynamics 365 Contact Center

New! Quick response templates⚡

Save time with the new custom templates!

Leaderboard

#1
André Arnaud de Calavon Profile Picture

André Arnaud de Cal... 291,188 Super User 2024 Season 2

#2
Martin Dráb Profile Picture

Martin Dráb 230,030 Most Valuable Professional

#3
nmaenpaa Profile Picture

nmaenpaa 101,156

Leaderboard

Featured topics

Product updates

Dynamics 365 release plans