Octagon Square
ContactTake the Reality Check
Stop running campaigns. Start running experiments
Point of viewInsight

Stop running campaigns. Start running experiments.

Matthew Webb·2 min read·Apr 2026

Most marketing teams run campaigns. Very few run experiments. That single difference quietly decides who compounds and who just stays busy.

Activity versus evidence

A campaign has a brief, a budget, and a hope. You design something, push it live, and watch the topline for movement you can't fully explain. An experiment has a hypothesis, a control group, and a measurable outcome. One produces activity. The other produces evidence, and only one of them makes you smarter next time.

The pattern across the real-world tests I've been reviewing is consistent, and a little uncomfortable for big-budget teams. The businesses generating the highest commercial returns are rarely the ones spending the most. They're the ones testing the smallest things with the most discipline.

Small, controlled, measured

A QR code on a receipt to see how many anonymous guests will identify themselves. A single-question survey on a menu page. A digital scratch card sent at 3pm on a Friday to a held-out segment. Small, controlled, measured against a group that didn't receive it, then scaled only once it works.

Contrast that with the big bang: the quarter-defining campaign launched to everyone at once, no control group, no clean way to know what actually worked. When it succeeds, you can't repeat it on purpose. When it fails, you can't say why.

⚠️
A campaign with no control group isn't bold. It's expensive guessing dressed up as ambition.

The question that changes everything

Here's the mindset shift, in one line.

💡
A campaign asks "what should we launch?" An experiment asks "what do we believe, and how would we know if we were wrong?"

The first protects egos. The second builds an organisation that learns faster than its competitors, which over a few years becomes an almost unfair advantage.

The quiet bonus is that experiments lower the stakes. You stop betting the budget on a hunch and start placing small, cheap wagers, keeping the winners and killing the losers early. Failure gets smaller and learning gets faster, at the same time.

So take one thing into your next planning session and refuse to launch it until it has a hypothesis and a control group. Pick the part of your marketing you're most confident about. That's usually the belief most worth testing, and the one most likely to surprise you.

Share
More thinking

Put this thinking to work on your guests.

Take the Reality Check