I recently went back to my vault of notes from the IPA Eff Test, something i do now and then. And boy do i have a nerdy new set of fun ways to think about effectiveness, hand-rolled just for you! I did this because a recent conversation emerged in our private community, on objectives and KPIs. So here's how i usually talk about it with clients, and yes this should be even before you brief the work. Broadly inspired by the wisdom of Binet & Field, who if you don't know of them – go look them up. Below i'm gonna cover:
If you find this feels boring, i won't blame you. If you don't, then you're on the right track. Let's get into it. 1. How the process worksIt sounds basic AF, but any measurement project needs to follow a simple process:
Shout out to the "correct for other factors" point in particular, which most of us overlook. I know why we do it, it makes our jobs look much more impactful, but it's also faulty. If an ad campaign correlates with sales growth, that's better than it not correlating, for sure. But the real question is, what else might have influenced those sales?
This stuff matters, not because we want to undermine the role of campaigns and content. But precisely because we want to prove their real contribution to the bottom line. 2. What ROMI (AKA ROI) really isAnother point on this is how you demonstrate true Return On Marketing Investment. Which is not to be confused with Return On Ad Spend, which is a paid media metric. The real kicker is when you're able to demonstrate that:
So for example, the real gangster move of an IPA-level paper is not just when you link ads to sales. It's when you prove this had greater impact than simply investing in, for example, new products. The formula goes like this:
And yes, by "cost of activity" we must include production costs as well. From memory, examples like Audi and Cadbury have successfully done all this with their papers. And they demonstrated that the single biggest contributor for increase in profit was the communications. Oh yeah, speaking of that... 3. Profit, not salesAnyone can increase sales by putting prices down. The real gangster result is whether you generated incremental profit, i.e. greater shareholder value. This also makes things harder, but more rigorous, when we evaluate claimed results out there. Awareness went up by X% and sales went up by Y% is ok, but nowhere near enough.
That last one is called "price elasticity", and we don't spend nowhere near enough time talking about it. Bottom line, the role of brand building in many cases is to help you command and justify higher prices. Which, in turn, means you have healthier margins, and therefore a healthier business in the long run. This stuff ain't rocket science. Though sometimes it feels harder. Now, let's talk about attribution. Oh, attri–fuckin'–bution. 4. Attribution models are faulty as shitIn principle, they make total sense. The last thing you tracked is the thing that closed the sale. The problem is that this usually means most of your performance is tied to paid search or paid social. But what primed people to want to search for you or recognise you before deciding to respond? That's where brand building comes in, and attribution rarely accounts for it. A useful analogy for this comes from supermarkets. If we say last touch attribution is all that matters, then the single biggest driver of sales for a supermarket is the fact it has doors in the physical store, or a basket checkout piece of software on their website. Doesn't look so credible now, does it? But there's also a danger of simply relying on ROMI, because it tends to go up as investment goes down. So you can effectively have greater looking ratios while the business is actually doing worse. Bummer. 5. Types of objectivesThere are many schools of thought on how to think about objectives and KPIs. I tend to group them broadly as two buckets: commercial, and communications. Commercial is the money making stuff. Communications is what people take out of you comms. For this to work, you need evidence that an increase in comms takeout leads to money being spent. Which ties to another fun topic called "category entry points", which i will do a summary of soon. But for now, let's stick to simple things: commercial and comms objectives. Each with their own sets of measures, of course. Commercial measures can be organised by things like:
By the way, one note on something that took me ages to properly wrap my head around.
So you can have, say, 13% market share, but a 28% penetration among families with young kids. Or 47% market share, but under-indexing on market penetration with 18-34s. Crucial point for when you see these terms, so you know what they really mean. Comms objectives and measures are the things that precede these more money-related things.
This is where advertising and content typically play, and without measuring them, you got very little. (Sorry, case studies where the 'effectiveness' part just says you go 10 million video views!) Also worth noting that objectives and measures of success need to be, among other things, specific.
Another useful way of looking at it is to consider soft vs hard objectives. Soft objectives are things like the above, which is what people say they think or feel or will do. Hard objectives are the proof is the pudding, i.e. the result of soft objectives delivering real action. Something else that was super clear to me by the time i was done was how objectives flow in a business. Meaning, one manager's strategy can become the next manager's objectives, for example:
Neat, huh? Another part of comms objectives may involve staff perceptions:
Which, by the way, is one of the under-discussed roles of brand purpose: its ability to attract talent. One for another deep dive, some other time. This is already getting long. Why all this mattersLook, sometimes i open conversations on measurement by saying something self-deprecating: "Ok my job is to talk about the boring stuff which will save us a lot of pain in 12 months' time." But the evidence is clear: IPA data shows that clear objectives quadruples overall effectiveness. No clear objectives means you leave a helluva lot of money on the table. And are inevitably a victim to a lot of uncomfortable questions about what your impact really was. It's how brands like Lidl, Baileys, Audi, Cadbury, McCain, Guinness or Specsavers have won big time. And learning from examples like them and The IPA, not just LinkedIn hot fads, is how we can win too. That's all for nowI hope this was useful, it certainly blew my mind when i wrapped my head around how it all works. I just wish someone had taught me this at 25, instead of accidentally needing to learn about it at 35. But hey, hopefully you'll get ahead of me now as you go about your journey too!
|
Helping savvy strategists swim upstream.
Hey friend – Rob here. Do you worry about things? Or at all? My suspicion is that you worry far too much about everything. But don't worry, so do i. I think it's part of what makes strategists minimally good at the job. We are always wondering what else we might be missing. It's not a point of advantage, but it's definitely a point of parity. Worrying means we don't take anything for granted. And that's the first ingredient you need to challenge preconceptions about a problem. However. As you...
Hey friend – Rob here. A few months ago i kicked off a video interview series, starting with Chris Rawlinson, founder of 42courses. You can watch it here. It was genuinely one of those wide ranging conversations where you start on point A and finish on point 37.1. And if that structure makes no sense, it's by design. I love randomness in exchanges. Anyway, there's tons of wisdom that i got out of Chris's brain, and some good lessons to help us all grow with a greater sense of compassion,...
Hey friend – Rob here. At its peak, Crispin Porter + Bogusky lived and died by a thought: “Don't write the idea, write the news headline.” This is true for creatives, but should also be true for our briefs. Sure – back them up, add context, explain where we’re coming from. But never lose sight of the headline of what you're asking. Friedrich Nietzsche once said: "I want to say in ten sentences what others say in a whole book." How often do you see briefs that are comprehensive, but not clear?...