You need a PLAN to deal with duplicates
Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.
And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:
- Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?
Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.
![]()
Wes's Wednesday Wisdom Archives
Baby Steps
One of the keys to developing good data management habits is to be aware of […]
Success Requires Discipline
When it comes to data management, most of us know what to do; we just don’t […]
Take a moment to be grateful
Because we’re so focused on always improving what we have now, it’s easy to overlook […]
KPIs and Dashboards
I saw DJ Muller from MemberClicks speak on KPIs (key performance indicators). In his session […]
Documenting Process is Critical
When it comes to managing data successfully, process is critical. For example, a client of […]
Motion vs. Action
In James Clear’s book Atomic Habits (I recommend it!), he discusses the concept of motion vs. action. […]
Are You Answering Your Calls?
I’ve written about this before, but apparently I have to keep repeating it. If you’ve […]
Who do you trust?
Who Do You Trust I was reading an article recently about Warren Buffet’s “rules” for […]
Set benchmarks to measure progress
It’s impossible to measure progress if you don’t know your starting point. This sounds axiomatic, […]
You’ll make incorrect decisions. Acknowledge them and fix it.
A client of mine recently wrote the following to me: “It’s so hard to set […]
