Direct mail has earned its place in marketing through trust, credibility and cut-through. But too often, it’s treated as static – designed once, sent once, measured once.
You’re missing opportunities.
Direct mail can be just as testable and performance-driven as digital marketing. When structured correctly, A/B testing transforms mail from a fixed cost into an optimisation channel – one that improves response rates, reduces waste and strengthens ROI over time.
If you’re not testing your mail, you’re guessing.
In this blog, we’re sharing how to do it properly.
What is A/B Testing in Direct Mail?
A/B testing (also called split testing) involves sending two variations of a mailing to similar audience segments to measure which performs better.
You change one variable.
You measure the outcome.
You apply the learning.
Unlike digital testing, where results can be instant, mail requires some planning and discipline (which you can leave to use). But the insights gained tend to be deeper, because the engagement is more deliberate.
The goal isn’t creativity for creativity’s sake. It’s measurable improvement.
What Should You Test?
The key to effective A/B testing is isolation, so the trick is to change one meaningful element at a time. We’re going to keep this pretty simple – here are the most impactful variables to test in direct mail:
1. Headline or Opening Line
Your headline drives initial attention. Testing tone can reveal what resonates:
- Direct vs supportive
- Urgent vs informative
- Outcome-led vs problem-led
Small shifts in language can create measurable differences in response.
2. Call to Action (CTA)
The CTA is often the most influential element in driving conversion.
Test:
- “Call today” vs “Visit our secure portal”
- Deadline-driven vs open-ended
- QR code placement vs URL prominence
Clarity and friction reduction matter more than clever wording.
3. Offer or Incentive
In fundraising, debt recovery, retail or public campaigns, the framing of an offer can significantly affect response.
Test:
- Early payment incentives vs reminder notices
- Suggested donation amounts vs open fields
- Instalment options vs full balance emphasis
The psychology behind choice plays a large role here.
4. Format and Design
Postcard vs letter.
Envelope messaging vs plain envelope.
Long-form explanation vs concise summary.
Format affects perceived importance. In regulated industries, for example, a formal letter may outperform a promotional-style mailer simply because of perceived legitimacy.
5. Personalisation Depth
Does adding personalised references increase response? Or does it feel intrusive?
To find this out, you might test:
- Basic name personalisation vs tailored content
- Localised references vs general messaging
- Account-specific details vs summary information
Variable Data Printing makes these tests operationally viable at scale.
How to Structure a Proper Test
Okay so, the point of these tests is to get actionable info about your campaign, and testing without structure leads to misleading conclusions, so that’s rather useless. To get meaningful A/B testing results, here’s what to do:
Keep Audience Segments Comparable
Split your data randomly and evenly. Ensure demographics and behavioural history are balanced across both groups, so that your data doesn’t get skewed by background variables.
Test One Variable at a Time
If you change the headline, CTA, and format simultaneously, you won’t know which change caused the difference in response. Take it one step at a time, and get your results in before changing tests.
Define Success Before You Start
Does success for you mean:
- Response rate?
- Payment rate?
- Average donation value?
- Portal visits?
- Reduced inbound queries?
Clarity here prevents bias later (because as results roll in, you might be tempted to change your definition to best suit your wants – we understand, but that makes the testing a whole lot less useful).
Allow Sufficient Volume
Statistical reliability matters, and very small sample sizes can distort results. Wherever possible, test with enough volume to make the data meaningful.
Measuring What Matters in Mail
Unlike digital channels, direct mail doesn’t rely on impressions or click-through rates alone. Its impact is measured in tangible outcomes – actions taken in the real world. As such, effective measurement should focus on:
Unique QR Codes or URLs
Assigning distinct QR codes or personalised URLs (PURLs) to each test group allows you to track exactly which version prompted the most engagement. This allows you to attribute clearly without relying on assumptions.
Dedicated Phone Numbers
Using unique contact numbers for each variation enables accurate call tracking, including call volume, duration and conversion outcome. This is particularly valuable in debt recovery, financial services or high-value B2B campaigns where engagement over the phone drives resolution.
Payment Portal Tracking
Custom landing pages or coded entry points into online portals allow you to connect offline mail with online behaviour – capturing payment completions, form submissions or account logins.
Response Forms
Traditional reply forms still play an important role in sectors like charity fundraising or public services. Coding these forms lets responses be attributed to the correct test group.
Time-To-Response Metrics
Beyond total response rate, measuring how quickly recipients take an action provides more (and more actionable) insight. One version may not generate more responses overall, but it may drive faster engagement, improving cash flow or operational efficiency.
It’s also important to keep in mind that direct mail frequently drives assisted conversions. A recipient may receive a letter, consider it for several days, then respond through a separate digital channel. Without integrated tracking, that influence can be underestimated.
When properly measured across channels, mail often performs better than internal assumptions suggest – particularly in regulated or sensitive communications, where trust and perceived legitimacy directly influence action.
Why A/B Testing in Mail is Underused
Despite its potential, A/B testing in direct mail is often overlooked.
Many organisations assume print is too slow to iterate, too expensive to test, or too operationally complex to manage variations. In reality, the greater cost lies in repeatedly sending underperforming communications without learning from them.
Poorly optimised mail wastes:
- Print and postage
- Internal resource time
- Opportunity to improve response rates
Fortunately, modern workflows remove many of the traditional barriers to testing. Automation and API integrations used by mailing houses like bakergoodchild now make the following possible without you having to lift a finger:
- Rapid file processing – Test splits can be generated quickly and securely without manual handling or spreadsheet manipulation.
- Controlled versioning – Multiple creative or copy versions can be produced within the same production run, ensuring consistency and eliminating production delays.
- Clean data segmentation – Randomised, balanced audience splits reduce bias and improve statistical reliability.
- Efficient print production at scale – Digital print technology enables variable content without slowing throughput or increasing complexity.
With these systems in place, testing becomes simply part of your campaign architecture rather than a manual operational burden.
The Long-Term Value of Testing
So, why do all of this? The truth is, A/B testing isn’t going to result in a big, single uplift – it’s about incremental, cumulative improvement.
Small gains compound. A 5% increase in response rate, repeated across multiple campaigns over a year, becomes significant. Over time, testing helps organisations:
- Reduce cost per acquisition
- Improve payment recovery rates
- Increase donation values
- Strengthen engagement in public sector communications
- Reduce wasted print and postage
Beyond performance metrics, testing builds internal confidence. Marketing, compliance and leadership teams move away from subjective debates about wording or design and toward data-backed decisions.
Testing creates evidence. Evidence creates confidence.
Where Print and Data Work Together
For A/B testing in direct mail to deliver reliable results, print and data can’t operate in isolation. After all, A/B testing is only as strong as the data behind it.
Accurate cleansing, suppression management and secure handling ensure:
- Clean test splits
- Reduced duplication
- Reliable tracking
- Compliance integrity
When print production, data management and reporting sit within a single, controlled workflow, testing becomes repeatable and scalable – not experimental or risky.
This is where experienced print and mail partners make the biggest difference. With properly integrated systems, automation and secure data handling in place, organisations can test confidently, learn continuously and improve consistently.
Ready to Test Your Direct Marketing Campaigns?
Direct mail isn’t static, it’s not a legacy channel, and it’s certainly not untestable.
When taken on strategically, it becomes a tool that combines the credibility of print with the optimisation mindset of digital.
A/B testing removes guesswork, sharpens messaging, and improves ROI.
And in an environment where budgets are scrutinised and results matter, shifting from assumption to evidence is simply the right move.
At bakergoodchild, we help organisations integrate secure data, automation and intelligent print workflows to make testing practical and measurable, so every campaign performs better than the last. Because in modern communication, improvement shouldn’t be occasional, it should be designed in.
To get the best ROI from your direct mail campaigns, give us a call at 0800 612 1972. Our friendly team will be happy to help you find the best way forward.
