Schedule Duplicate Detection Job

With the DeDupeD app, you can schedule duplicate detection jobs to run and automatically detect duplicates on a daily, weekly, or monthly basis. As well as send the duplicate detection report link consisting of all the fetched duplicate records to the desired CRM users via mail.

For example: you can schedule a duplicate detection job to automatically run every month and detect duplicate contact records created throughout the month, and then mail the duplicate detection report to your desired users.

To create and schedule a duplicate detection job you will have to follow the steps given below:

  • Navigate to DeDupeD App.

Schedule Duplicate Detection Job
  • Go to Duplicate Detection Job and click on “New” to create a new detection job.

  • Now fill in the following details:

    • Name: Give a suitable name for the Duplicate Detection Job.

    • Entity Configuration: Select the entity for which you want to run the Duplicate Detection Job.

    • Primary Entity: Select the primary entity for which you want to set up the duplicate detection job to run. For e.g. Here we will select ‘Contact’.

    • Matching Entity: Select the entity from which the duplicates will be retrieved. For e.g. Here we will select the ‘Contact’.

    • Notify Me (Email): Set this field to “Yes” if you want to send an email notification with a link to the duplicate detection job reports to the record owner.

    • Notify Others: Select the CRM users to whom the results of the duplicate detection job will be sent along with the record owner.

  • System Views: Select the entity view from which you want to detect duplicates.

  • Last X (Days): Select the last X days from where the duplicate records should be retrieved. Here, we will set it as 30 days.

  • Based On: Select the duplicate detection criteria based on which the duplicate records will be fetched from the selected entity view.

  • Hour: Set the hour at which the scheduled job should run. Here, we will set it at ‘15’.

  • Run On: Set the Day on which the scheduled job will run. Here, we will set it on ‘Friday’.

  • Minute: Set the minute when the scheduled job will run. Here, will set it as ‘30’.

  • Recur after every (Week’s): Set the number of weeks after which the scheduled job will run. Here we will set it run after every ‘4’ weeks.

  • Once you have filled in all the details, click on ‘Save’.

  • Now once your scheduled Duplicate Detection Job has been executed. You will be able to see the scheduled Job’s results being mailed to your selected users:

  • Navigate to Sales Hub -> Activities -> Click on the E-Mail.

Schedule Duplicate Detection Job
  • Automatic Mail has been sent to your desired users.

Schedule Duplicate Detection Job
  • Scroll down and you’ll find link for the duplicate detection job’s results. Click on this link and it will redirect you to the ‘Duplicate Job Run’ entity.

Schedule Duplicate Detection Job
  • Here you will find all the duplicate records detected through the scheduled duplicate detection job.

Schedule Duplicate Detection Job

This is how you can schedule duplicate detection job and mail it’s results to desired users with DeDupeD App.

Scheduled Auto-Merge

Auto-Merge via Scheduled Jobs

The Auto-Merge feature allows DeDupeD to automatically detect and merge duplicate records in bulk, on a scheduled basis, without any manual intervention.

Once configured, DeDupeD continuously keeps your CRM clean by:

  • Finding duplicates based on your rules

  • Selecting the best Master record

  • Merging duplicates automatically

  • Preserving all relationships, history, and activities

  • Producing a full audit trail of every merge

This is set-and-forget data hygiene for Dynamics 365.

What Auto-Merge Solves

Most CRM systems fail because duplicates keep getting created after cleanup.

DeDupeD Auto-Merge ensures:

  • New duplicates are merged as soon as they appear

  • Data never drifts back into chaos

  • Users never have to manually fix the same customers again

It is especially powerful for:

  • Accounts

  • Contacts

  • Leads

  • Any entity that is created at scale

How to Configure Auto-Merge in DeDupeD

Step 1 – Create a Scheduled Job

Go to: DeDupeD → DeDupeD Schedule Jobs → New

Enter:

  • Job Name (e.g., Jan Month Duplicates)

  • Entity Configuration (e.g., Account, Contact)

Step 2 – Choose the Entities

Select:

  • Primary Entity (e.g., Account)

  • Matching Entity (e.g., Account)

This defines what DeDupeD compares to find duplicates.

Step 3 – Enable Auto-Merge

Turn on:

Enable Auto-Merge of Duplicates = Yes

This tells DeDupeD:

Any duplicates found by this job should be merged automatically, no review required.

This is the switch that turns DeDupeD into a fully autonomous deduplication engine.

Step 4 – Define which records should be checked

Configure:

  • System View (e.g., All Accounts)

  • Based On (e.g., Created On)

  • Last X Days (e.g., 30 days)

  • Impersonate User (who runs the job)

This allows you to control:

  • Which records are scanned

  • Which user context is used

  • Which time window is processed

Step 5 – Schedule the Run

Define:

  • Hour

  • Minute

  • Day

  • Weekly recurrence

Example: Run every Friday at 10:12 AM.

This makes DeDupeD execute duplicate detection and merging automatically on that schedule.

Step 6 – Configure Email Notifications

Choose:

  • Notify Me

  • Notify Other Users

So stakeholders receive a report of:

  • Records processed

  • Duplicates found

  • Records merged

What Happens When the Job Runs

Once the scheduled time arrives:

  1. DeDupeD scans records based on your rules

  2. Finds duplicates using matching rules and logic

  3. Picks the best Master record based on advanced master deciding rules satisfaction criteria

  4. Merges all duplicates automatically based on merge rules

  5. Moves all relationships, activities, files, and history

  6. Deactivates the duplicates

  7. Logs everything

No clicks. No risk. No data loss.

How to Review Auto-Merge Results

Go to: DeDupeD → DeDupeD Job Runs

Each run shows:

  • Run time

  • Total records checked

  • Total duplicates found

  • Total records merged

  • Status

Open any Job Run to see:

  • Each master record

  • How many duplicates were merged

  • Whether it was auto-merged or manual

How to Verify Auto-Merge Result in CRM

Open any record that was merged.

You will see:

“This record has been merged with [Master Record]”

The duplicate is:

  • Inactive

  • Fully merged

  • All data preserved

circle-check

Last updated

Was this helpful?