You’re offline. This is a read only version of the page.
135
Hello All,
We have inserted 50k duplicate data how can i detect and delete the records in dynamics 365?
When i tried duplicate detection rules it says as per the below SS.
Please suggest.
Regards,
Hima
I have found the duplicate records using the deduplicator. But how do i delete them? there's no option to delete them
excellent solution!
Hi HimaM,
Since 35000 records are too many, you have to take another solution, which is to reduce the scope of duplicate detection.
Detect less than 5000 records at a time and delete them, execute them in batches.
1. First, create a personal view of the entity that need to delete duplicate records, set the filter of the view a liiter more strictly, that is you need to control the number of records in this view to be around 5000 or slightly more than 5000.
Use Advanced Find to quickly create personal views.
Then, repeatedly create personal views, the filtering of each personal view should be different, and control the number of records in this view to be around 5000, until all personal views contain all records of the entity.
In this case, we divide the huge number records in one view into the appropriate number of records in multipe personal views.
Then run bulk system jobs to detect duplicate records on these personal views, create bulk system jobs multipe times, selecting a different personal view each time.
In this way, the scope of detect duplication is reduced to a single personal view and the detection result must be less than 5000 records, so they will be successfully deleted.
Here are the relevant documents for reference.
How to Create and Share Personal Views in Microsoft Dynamics 365: https://www.magnetismsolutions.com/blog/adammurchison/2017/09/14/how-to-create-and-share-personal-views-in-microsoft-dynamics-365
Run bulk system jobs to detect duplicate records: https://docs.microsoft.com/en-us/power-platform/admin/run-bulk-system-jobs-detect-duplicate-records
Hi HimaM,
Since 35000 records are too many, you have to take another solution, which is to reduce the scope of duplicate detection.
Detect less than 5000 records at a time and delete them, execute them in batches.
1. First, create a personal view of the entity that need to delete duplicate records, set the filter of the view a liiter more strictly, that is you need to control the number of records in this view to be around 5000 or slightly more than 5000.
Use Advanced Find to quickly create personal views.
Then, repeatedly create personal views, the filtering of each personal view should be different, and control the number of records in this view to be around 5000, until all personal views contain all records of the entity.
In this case, we divide the huge number records in one view into the appropriate number of records in multipe personal views.
Then run bulk system jobs to detect duplicate records on these personal views.
In this way, the scope of detect duplication is reduced to a single personal view and the detection result must be less than 5000 records, so they will be successfully deleted.
Hi HimaM,
I would suggest that you first find all duplicate records through XrmToolBox, then merge or delete part of them, and wait until there are less than 5000 duplicates, you can ues OOB delete duplicate records feature.
Alternatively, narrow down the scope of the duplicate detection rule, first find duplicate records within 5000, delete them, and then find other duplicate records and delete them.
Deduplicator for XrmToolBox
Deduplicator helps you find duplicated records in Microsoft Dynamics 365 CE / CRM with ability to overcome CRM limitations.
This is the download page of XrmToolBox: https://www.xrmtoolbox.com/
After downloading and unzipping it, open 'XrmToolBox.exe'.
Contact it to your D365 organization. At Tool Libarary, install 'Deduplicator'.
First Load Entities, then select Entity and fields, finally Find duplicates.
Stay up to date on forum activity by subscribing. You can also customize your in-app and email Notification settings across all subscriptions.
#1
André Arnaud de Cal...
290,900
Super User 2024 Season 2
#2
Martin Dráb
229,275
Most Valuable Professional
#3
nmaenpaa
101,156
Share
Report
All responses (
Answers (