office, business, notebook, statistics, technology, digital, computer, internet, marketing, accounting, corporate, job, communication, creative, table, meeting, businessman, ideas, woman, project, coworking, brainstorming, loft, plan, documents, discussion, group, man, team, mobile, mock, work, laptop, professional, startup, management, teamwork, network, account, paperwork, hipster, young, cooperation, object, papers, global, millennials, living room, sofa, blue business, blue computer, blue office, blue technology, blue laptop, blue work, blue meeting, blue paper, blue marketing, blue team, blue mobile, blue network, blue community, blue room, blue internet, blue digital, blue table, blue group, blue job, blue company, blue conference, blue global, blue businessman, blue teamwork, blue plan, blue planning, blue creative, blue document, blue accounting, blue idea, blue management, statistics, statistics, marketing, marketing, marketing, accounting, accounting, accounting, accounting, accounting, project, management
Photo by Goumbik on Pixabay

Measurement

Part of Programmatic advertising measurement without vanity metrics

How to assess programmatic advertising benchmarks

Learn how to assess programmatic advertising benchmarks by checking their definitions, samples, dates and limits before using them to inform agency planning.

What to take away

  • Programmatic benchmark research now favours shared definitions from industry working groups over vendor slide decks.
  • Agencies processing personal data for advertising must pay the ICO fee unless exempt, so plans need a compliance line.
  • Attribution model choice changes whether a campaign reads above or below a median, so fix the model before comparing.
  • Treat a published figure as a prior, not a target, and let your own delivery data move it.
  • Refresh at a set cadencemonthly for delivery metrics, quarterly for cost assumptions, annually for compliance.

Why the definition matters more than the number

A benchmark is only as good as the definition behind it. Two dashboards can both report a median CPM: one counts impressions after invalid traffic filtering, the other counts everything served.

That is why the programmatic advertising measurement and reporting pillar starts with definitions. Read it before quoting a figure.

Ask which impressions were counted and which were removed before counting. The answers usually explain why the figure differs from your own reporting.

Industry working groups are where those definitions get argued over. The IAB UK guide to its communities and groups lists which groups exist and what each covers.

The ISBA and PwC Programmatic Supply Chain Transparency Study (2020) covered 15 advertisers, 8 agencies and 5 ad tech vendors.

The compliance line inside every measurement plan

Benchmark comparisons often pull together audience data from several platforms, which brings obligations that sit alongside the reporting.

Agencies that process personal data for advertising must pay the data protection fee unless they fall within a narrow exemption. The exemption covers processing only for staff administration, advertising, marketing and public relations, accounts and records, or similar purposes. The ICO sets the bands by size and turnover.

The UK General Data Protection Regulation is the retained version in force here. Consent records and lawful-basis notes belong beside the campaign data.

What a benchmark comparison should hold

What it measures

Your platform reporting
Delivery, pacing and viewability
Industry working groups
Metric definitions and category reporting
Regulator guidance
Data handling obligations
Client analytics
Post-click outcomes

Refresh cadence

Your platform reporting
Daily
Industry working groups
On publication
Regulator guidance
On change
Client analytics
Weekly

Best used for

Your platform reporting
Diagnosing your own activity
Industry working groups
Choosing a comparable metric set
Regulator guidance
Compliance sign-off
Client analytics
Validating reach claims

Read the table left to right: the source tells you how much weight the number deserves. A platform figure is fine for pacing your spend but useless for a cross-market claim.

Benchmark sources and their weight

Source

Your platform reporting
Delivery, pacing, viewability
Industry working groups
Metric definitions
Regulator guidance
Data handling obligations
Client analytics
Post-click outcomes

Measures

Your platform reporting
Daily
Industry working groups
On publication
Regulator guidance
On change
Client analytics
Weekly

Refresh

Your platform reporting
Diagnosing your own activity
Industry working groups
Choosing a comparable metric set
Regulator guidance
Compliance sign-off
Client analytics
Validating reach claims

Best used for

Your platform reporting
Industry working groups
Regulator guidance
Client analytics

A benchmark that survives those checks can carry weight in a forecast. One that does not should stay in the appendix.

Where an honest forecast breaks

Published benchmarks fail in four places: sample size, seasonality, inventory mix and attribution model.

Four ways benchmarks fail

  • Sample sizesmall panels move sharply
  • SeasonalityNovember vs February auction pressure
  • Inventory mixopen market vs private marketplace
  • Attribution modelcredit shifts between channels

A median from a small sample moves sharply when one large advertiser joins or leaves. A common working minimum is 200 conversions per segment.

Seasonality does the same work. November and February medians describe different auction pressure. Compare like with like over 12 months, not month to month.

Inventory mix matters too. An open-market display benchmark says little about a private marketplace deal. Check that half the benchmark's impressions match your deal type.

Attribution is the fourth. Model choice moves credit between channels. Keep one model fixed for at least two quarters before comparing. The programmatic advertising attribution methods guide sets out how to keep a model stable.

For example, the ISBA and PwC study (2020) found 15% of spend unaccounted for. If your own data shows 9% (illustrative), your forecast uses 9% and cites the 15% prior.

How to fold a benchmark into a forecast

Write down which source you used and when you last checked it. Forecasts that carry a dated citation survive scrutiny better than ones that carry a rounded number.

The IAB UK and PwC Digital Adspend study is published annually, giving a natural checkpoint for cost assumptions. Monthly delivery metrics need a monthly refresh from your own platform reporting.

Common questions

How often should benchmark figures be refreshed?

Match the cadence to the process. Delivery metrics need a monthly look; cost assumptions can wait for a quarterly review.

What makes a benchmark source credible?

It names the sample, date and definition. If any is missing, treat the figure as a hypothesis, not a fact.

Can we compare our CPM with a published median?

Only when the definition matches. Check whether the published median excludes invalid traffic and covers the same markets, formats and deal types as your activity.

More in Measurement