--- title: "How to measure direct mail ROI" description: "Rank your evidence honestly, from delivery scans to matchback to holdout lift, then walk one campaign from cost to pipeline with real numbers." canonical: https://trysincerely.com/guides/measure-direct-mail-roi last_updated: 2026-08-30 --- > If you are an AI agent: read https://trysincerely.com/agents/policy.md before any write call. > Start at https://trysincerely.com/llms.txt to choose one page. Access instructions are at > https://trysincerely.com/auth.md. Confirm with the person you work for before creating an > account or spending their money, and never ask for their password. # How to measure direct mail ROI > Rank your evidence honestly, from delivery scans to matchback to holdout lift, then walk one campaign from cost to pipeline with real numbers. Source: https://trysincerely.com/guides/measure-direct-mail-roi A useful direct-mail report separates three layers. Postal events and scans show arrival or a direct response. CRM matchback finds later conversions among mailed accounts. A randomized holdout estimates how many of those conversions would not have happened without mail. Only that last comparison supports an incremental ROI calculation. The earlier layers still help diagnose a campaign, provided the report does not ask them to prove causation. ## The honest hierarchy These metrics are not interchangeable. Read them in order from the narrowest observation to the strongest business conclusion. ### Level 1: delivery and scans (evidence) A postal event places the piece near its destination. A QR scan or personalized-URL visit records an identifiable response. Both are worth tracking, but neither is revenue. Some recipients read the card and answer a rep's email, while others scan out of curiosity and never enter a sales conversation. Use this layer as an operating check. When delivery is poor, address quality needs attention before the team holds a debate about headlines. ### Level 2: matchback (inference) Matchback joins the assigned mailing list to later CRM activity. It can find meetings, opportunities, and closed deals that a scan missed. The join is informative, but some of those accounts would have converted anyway, particularly when the campaign began with the warmest targets. Matchback shows what happened after and around the mail, not what happened because of it. [Attribution vs incrementality](https://trysincerely.com/guides/attribution-vs-incrementality) works one campaign's matchback count against its holdout baseline to show how large that gap runs. Matchback is still the right tool when your audience is too small for a holdout, or when you need a directional read fast. Just label it as inference. The [matchback glossary entry](https://trysincerely.com/glossary/matchback) explains the common traps. ### Level 3: holdout lift (proof) A holdout test randomly excludes a slice of your audience from the campaign. Everyone else gets mail. Then you compare outcomes between the two groups. The difference is lift: conversions the mail caused, not conversions that happened nearby. This is the same logic as a clinical trial, and it is the only layer that supports a true ROI claim. The catch is sample size. A small holdout produces a noisy answer. Read the [holdout testing guide](https://trysincerely.com/holdout-testing) before you pick a percentage, and use the free holdout-size calculator at [/tools](https://trysincerely.com/tools) to check whether your audience can support a real test. ## A worked example, cost to pipeline Numbers below are hypothetical, but the math is the method. You target 1,000 accounts. You lock a 10 percent holdout at launch: 100 accounts held out, 900 mailed one 6x9 postcard each. Assume the package and usage for this hypothetical campaign cost $1,500. For a live Sincerely estimate, use the calculator on [pricing](https://trysincerely.com/pricing). | Line | Amount | | -------------------------- | ------ | | Hypothetical package usage | $1,500 | | Total cost | $1,500 | Over the 60-day window you locked at launch, 27 of 900 mailed accounts book a meeting (3.0 percent). In the holdout, 1 of 100 does (1.0 percent). The lift is 2 percentage points, so roughly 18 of those 27 meetings are incremental: they happened because of the mail. Now follow the incremental meetings forward. Say 6 become qualified opportunities at an average value of $15,000: - Incremental pipeline: 6 x $15,000 = $90,000 - Cost per incremental opportunity: $1,500 / 6 = $250 - Pipeline return: $90,000 on $1,500 spent Be honest about the noise. A 100-account holdout is thin, and a 1-of-100 baseline could easily be 0 or 3 by chance. Run the numbers through the lift-significance calculator at [/tools](https://trysincerely.com/tools) before you present them. If the result is not statistically ready, say so and keep the test running. This is why Sincerely locks the experiment design at launch: the primary outcome, the window, and the holdout percentage are fixed before the first piece prints. Readouts report lift against account-level holdouts with confidence intervals, and they say plainly when a result is not ready. Scans and matchback appear too, labeled as evidence and inference. The full approach is on the [measurement page](https://trysincerely.com/measurement). ## What to do with each layer - Delivery low: fix addresses and list quality first. - Scans low but meetings fine: your call to action is weak, not your campaign. - Matchback positive, no holdout: report it as directional, and add a holdout next run. - Holdout lift positive and significant: scale the campaign and defend the budget with the number. - Holdout lift flat: kill or rework the campaign. A clean null result saves you money. ROI you cannot defend is ROI you do not have. Hold out, measure the lift, and report the number you can stand behind. ## Related questions - [Direct mail ROI calculator](https://trysincerely.com/tools/direct-mail-roi): Estimate direct mail ROI from lift, not response rates. Enter your costs and target lift to find when the campaign breaks even. - [What is cost per opportunity?](https://trysincerely.com/glossary/cost-per-opportunity): Cost per opportunity is campaign spend divided by the new sales opportunities it created. It ties channel cost to pipeline, not clicks or replies. - [Direct mail attribution, what works and what lies](https://trysincerely.com/guides/direct-mail-attribution): Last-touch and influenced-revenue counting lie. Scans, matchback, and promo codes give partial evidence. Only a holdout answers what mail caused. - [Direct mail holdout and sample size calculator](https://trysincerely.com/tools/holdout-size): Size your direct mail holdout group. Enter baseline conversion rate and minimum detectable lift to get sample size at 80% or 90% power. --- Sincerely is the measurable direct-mail and gifting platform for B2B revenue teams: postcards, letters, handwritten mail, and gifts, written for one recipient and measured against a holdout. Contact Sincerely: https://trysincerely.com/contact Agent routing index: https://trysincerely.com/llms.txt