Skip to content

Data hygiene

Clean data is faster data.

Every list starts decaying the day it's created. People move, change jobs, abandon inboxes and port phone numbers. Hygiene is the routine work that keeps records accurate, deliverable and lawful to use — and it's the cheapest way to make every campaign perform better.

The case for cleaning

Why hygiene matters more than volume

It's tempting to measure a database by how many records it holds. The more useful measure is how many of those records are accurate, reachable and permissible to contact. A smaller, clean list routinely outperforms a larger dirty one — and it costs less to use.

Dirty data shows up in predictable ways:

  • Wasted spend: printing and postage on undeliverable mail, sales time on dead numbers.
  • Sender reputation damage: bounces and spam-trap hits can push future email toward the spam folder.
  • Compliance exposure: calling numbers on Do Not Call lists or contacting people who opted out.
  • Bad decisions: duplicate and inconsistent records distort reporting, scoring and territory planning.
  • Poor experience: customers who get three copies of the same mailer, or an email using the wrong name.

Postal

Standardize addresses and catch moves before you print and mail.

Email

Identify invalid, risky and role-based addresses before you send.

Phone

Know the line type and scrub against Do Not Call lists before you dial.

Records

Merge duplicates and standardize formats so every system agrees.

Mailing addresses

Postal hygiene: CASS and NCOA concepts

Postal hygiene rests on two ideas. First, an address should be correct and standardized — the way the postal system expects to see it. Second, it should still be current for the person you intend to reach. In the United States those two ideas map to two well-known processes, often referred to by their acronyms.

CASS: is this address valid and standardized?

CASS stands for Coding Accuracy Support System. CASS-certified software checks each address against official postal reference data and standardizes it. In practice that means:

  • Correcting misspelled street and city names and normalizing abbreviations ("Street" to "ST," "Apartment" to "APT").
  • Verifying that the street, house number and unit actually exist.
  • Adding the ZIP+4 code and delivery point information used for postal presort.
  • Flagging addresses that are vacant, undeliverable or missing a required unit number.

Standardized addresses are also essential for matching. Two records for "123 North Main Street, Apt 4" and "123 N Main St #4" look different to a computer until both are standardized — at which point duplicates become obvious and append matching becomes more reliable.

NCOA: has this person moved?

NCOA stands for National Change of Address. When people or businesses file a change-of-address with the postal service, that information is made available to licensed processors. Running a list through NCOA processing identifies records that have moved and, where available, provides the new address. It can distinguish individual, family and business moves, so you know whether to update a single contact or a whole household.

Move updates are especially important for direct mail, but they also help any system that uses postal address as an identity anchor. A customer who moved is still your customer; an outdated address just makes them harder to recognize.

Postal hygiene steps and what each one catches
StepWhat it checksWhat you get back
ParsingSplits a free-form address into componentsSeparate number, street, unit, city, state and ZIP fields
Standardization (CASS-style)Address against postal reference dataCorrected, standardized address with ZIP+4
Deliverability flagsVacancy, missing unit, undeliverable statusIndicators to suppress or fix before mailing
Move update (NCOA-style)Filed change-of-address recordsNew address and move type, where available
SuppressionDeceased, prison and do-not-mail lists you choose to applyRecords flagged or removed before mailing
Postal hygiene steps and what each one catches

Before you send

Email validation, layer by layer

Email validation estimates whether an address will accept mail, without sending a message to it. It works in layers, each catching a different kind of problem. The output is usually a status per address — for example valid, invalid, risky or unknown — so you can decide how to treat each group.

syntax_checkSyntax
Is the address well-formed? Catches typos like missing @ signs, spaces or illegal characters.
domain_mxDomain and MX records
Does the domain exist, and is it configured to receive email? Catches dead and misspelled domains.
mailbox_checkMailbox response
Where the receiving server allows it, does the specific mailbox appear to exist?
role_flagRole-based address
Addresses like info@, sales@ or support@ reach a team, not a person — often poor fits for one-to-one outreach.
disposable_flagDisposable domain
Temporary inbox services used to dodge sign-up forms. Typically suppressed.
catch_all_flagCatch-all / accept-all
The domain accepts any address, so the mailbox can't be confirmed. Usually classed as risky.

How to act on the results

  • Invalid: remove or fix. Sending to these creates hard bounces.
  • Disposable: suppress for marketing; they rarely reach a real, attentive person.
  • Role-based: keep for transactional or account messages if appropriate; be cautious in marketing.
  • Risky or catch-all: send cautiously, in smaller batches, and monitor engagement closely.
  • Valid: safe to send from a deliverability standpoint — subject to consent and CAN-SPAM.

Validation is most effective in two places: at the point of capture, where a real-time check on your sign-up form stops typos before they enter your database, and before every large send, because addresses that were valid months ago may have been abandoned since.

Before you dial

Phone type identification and DNC scrubbing

Phone hygiene has two jobs: making sure a number is real and correctly categorized, and making sure you're allowed to call or text it for the purpose you have in mind.

Phone type identification

Line type identification classifies each number as landline, mobile or VoIP, and flags numbers that are disconnected or not in service. Line type matters because consent rules for automated calls and texts are stricter for mobile numbers, because texting only works on capable lines, and because it helps sales teams prioritize a direct mobile over a main switchboard.

Do Not Call scrubbing

Telemarketing calls to consumers must respect several layers of do-not-call preferences. A complete scrub checks all of them:

  1. 01

    The National Do Not Call Registry

    The federal registry lets consumers opt out of most telemarketing calls. Sellers and telemarketers who call consumers are generally required to access it and suppress registered numbers, and to refresh that check on a regular schedule.
  2. 02

    State Do Not Call lists

    A number of states maintain their own lists or have their own telemarketing rules. Requirements vary by state, so scrubs should account for the states you call into.
  3. 03

    Your internal do-not-contact list

    When someone asks you directly to stop calling, that request must be honored and recorded. An internal list is mandatory practice, not a nice-to-have, and it should be shared across every team and vendor that contacts on your behalf.
  4. 04

    Consent and exemptions review

    Some calls fall outside telemarketing rules, and an established business relationship or prior consent can change what's allowed. Those determinations are fact-specific — document them, and get legal advice when in doubt.

Reassigned numbers

Phone numbers get disconnected and reassigned to new people. A number that belonged to a customer who consented last year may belong to a stranger today — and the stranger never agreed to hear from you. Checking for reassignment before calling or texting on the strength of old consent is an important safeguard. In the US, a federal reassigned numbers database exists for exactly this purpose.

One record per reality

Deduplication and standardization

Duplicates creep in from everywhere: the same person filling out two forms, imports from trade shows, merges between systems, a sales rep creating a contact that already existed. Left alone, they inflate counts, split activity history and annoy customers.

Standardize first

You can't reliably find duplicates until values are formatted consistently. Standardization typically includes:

  • Names: consistent casing, separated first and last names, and handling of prefixes and suffixes.
  • Addresses: postal standardization so variants of the same address become identical.
  • Phone numbers: a single format, such as ten digits with no punctuation for US numbers.
  • Email: lowercased and trimmed of whitespace.
  • Company names: normalized legal suffixes ("Inc.", "Incorporated," "LLC") and common abbreviations.
  • Job titles: mapped to consistent seniority and department values for segmentation.

Then match and merge

Deduplication compares records using match rules — exact email, name plus standardized address, company domain plus contact name — and groups records that represent the same person or business. Some groups are certain; others are "probable" and benefit from human review. When merging, decide in advance which record "survives" and which field values win: the most recent, the most complete or the one from your most trusted source.

Common dedupe levels
LevelGroups records byTypical use
IndividualSame person (name + address, email or phone)Avoid duplicate outreach to one person
HouseholdSame residential addressSend one mailer per household
Contact at companySame person at the same businessClean CRM contact records
AccountSame company (domain, name + address)Consolidate accounts for ABM and territory planning
Common dedupe levels

Dedupe also applies across files, not just within them. Before mailing or loading a purchased list, compare it against your existing customers and suppression lists so you don't prospect people you already serve — or contact people who asked you not to.

Make it routine

A sensible hygiene cadence

There's no single schedule that fits every business; the right cadence depends on how fast your data changes and how often you use it. The principles below work for most teams.

  • Continuously, at capture: validate email and phone formats on forms, standardize addresses on entry and block obvious junk before it lands in your database.
  • Before every major campaign: run email validation before large sends, postal standardization and move updates before mail drops, and dedupe against customers and suppressions.
  • On a regular schedule for calling: re-scrub phone numbers against the federal and applicable state DNC lists at the interval the rules require, and update your internal do-not-contact list in real time.
  • Periodically for the whole database: refresh B2B records more often than consumer records, because job changes make business contact data decay faster than home addresses.
  • Whenever systems merge: imports, migrations and new integrations are the most common source of duplicates — dedupe as part of the project, not afterward.

Keep reading

FAQ

Frequently asked questions

Common questions about keeping postal, email and phone data accurate and usable.

What's the difference between CASS and NCOA?

CASS-style processing checks and standardizes an address so it's deliverable as written — correcting street names, adding ZIP+4 and formatting it to postal standards. NCOA-style processing checks whether the person or household at that address has filed a change-of-address and, if so, supplies the new one. One makes the address correct; the other makes sure it's still the right address for that person.

Is email validation the same as permission to send?

No. Validation tells you whether an address is likely to accept mail. It says nothing about whether the person agreed to hear from you. Consumer email marketing should be opt-in, and every commercial email must still follow CAN-SPAM requirements.

What is a catch-all domain, and should I mail it?

A catch-all (or accept-all) domain is configured to accept mail for any address, so a validation check can't confirm whether a specific mailbox exists. These addresses are usually classified as 'risky' or 'unknown.' Many senders mail them cautiously, in small volumes, and only to contacts they have another reason to trust.

If a number isn't on the National Do Not Call Registry, can I call it?

Not necessarily. You also need to account for applicable state DNC lists, your own internal do-not-contact list, and consent requirements. Autodialed or prerecorded calls and marketing texts to consumers generally require prior express written consent under the TCPA, regardless of DNC status.

Why does phone line type matter?

Rules differ by line type. Mobile numbers carry additional restrictions on automated calls and texts, and knowing whether a number is landline, mobile or VoIP helps you choose the right channel and consent standard. It also helps route records to the right team or dialing workflow.

How often should a list be cleaned?

It depends on how fast the data changes and how often you use it. As a rule of thumb, clean before every major campaign, run lighter checks continuously at the point of capture, and re-scrub phone numbers against DNC lists on a regular schedule if you call. See the cadence section on this page for a fuller guide.

Not sure how clean your list is?

Tell us what kind of records you have and how you use them. We'll recommend which hygiene steps matter for your channels and scope a cleanup that fits.