This. My biggest data lessons from 25 years in digital publishing / marketing to add to the efficiency/effectiveness debate:
1) There’s an important distinction between being data-driven and data-informed; more organisations need to lean towards the latter, because…
2) No numbers mean anything without context – almost everything measurable needs multiple other datapoints, timescales, and points of comparison to have any meaning
3) Most data tracked by marketing departments are vanity metrics with almost zero long-term value for the business as a whole
4) Pick the wrong KPIs (pageviews being the most obvious, revenue growth perhaps the least) you’re more likely to harm the business than help it by focusing on improving the *indicator* rather than the business-wide performance, because…
5) Almost every metric can be gamed or significantly impacted by outliers or picking the wrong points of comparison, but…
6) Not enough people check to see if this is what’s happening, especially if the results are looking good
7) Equally, just because you *think* you can measure something doesn’t mean this is what you’re actually measuring, or that it’s helpful to do so, but…
8) Tables of numbers and nice pretty charts (especially with trend lines) are addictive, while cross-referencing multiple metrics and trying to make sense of it all is difficult – not helped by most of the tools available being deeply unintuitive, so…
9) Most laypeople don’t bother asking about the methodology for fear of looking stupid, and just nod along, so…
10) Keep on questioning the data – who compiled it, how, when, where, why, and what could we be missing? Data interpretation is as much art as science – the more we question what we’re seeing, the more likely it is someone will have one of those sparks of inspiration that help you find something genuinely meaningful
—
What have I missed?
What have I got wrong?
