Skip to content
J·BJon BishopIndependent growth marketer

Paid media and measurement · Advertising measurement method demonstrated in a retailer campaign

Ghost Ads: Improving the Economics of Measuring Online Ad Effectiveness

Johnson, G. A., Lewis, R. A., & Nubbemeyer, E. I. (2017). Journal of Marketing Research, 54(6), 867–884.

Journal of Marketing Research · 2017DOI: 10.1509/jmr.15.0297 ↗

Plain-English take

In the demonstration campaign, retargeting lifted website visits by 17.2% and purchases by 10.5%. For your marketing: This is a foundational reference for asking an ad platform or analytics team how holdouts can measure incremental impact at lower cost.

How much weight to give this

2.5/5 Limited or context-dependent evidence

The 1–5 evidence-check score is a practical reading aid, not a formal peer review or a probability that a conclusion is true. It combines design strength (2 points), sample reporting (1), comparison/control clarity (1), and how much of the paper could be checked (1). Access affects how confidently this directory can assess a study, not the study's underlying quality. Blinding is reported separately because it is not relevant to every design.

Design · 1/2

The accessible description does not establish a strong causal design.

Sample · 0.4/1

A usable sample size is not stated in the profile's accessible source.

Comparison · 0.45/1

Comparison or control details are limited in the reviewed source.

Can we check it? · 0.5/1

This profile could be checked against an abstract or metadata, not the full paper.

Double-blind? Not applicable in the same way as a participant-treatment experiment.

Research question

What the authors investigated

Can online ad effectiveness be measured more economically while retaining the precision of conventional experiments?

Design

Introduces ghost-ad measurement and demonstrates it on a display-retargeting campaign for an online retailer.

Sample and setting

Retailer display-retargeting campaign; the publisher page reports recording over 100 million predicted ghost ads per day.

Reported result

What the study found

In the demonstration campaign, retargeting lifted website visits by 17.2% and purchases by 10.5%. The method is presented as achieving comparable precision to intent-to-treat and public-service-announcement tests at substantially lower experimental cost.

This is a paraphrase of the source. Check the original paper for definitions, estimates, statistical uncertainty and analysis details.

Scope and transfer

Limitations to keep in view

The reported campaign is a single retailer retargeting case. Measurement implementation depends on ad delivery systems and campaign eligibility; the abstract does not supply a SaaS-specific performance benchmark.

Possible founder application

A foundational reference for asking an ad platform or analytics team how holdouts can measure incremental impact at lower cost. Use current, independently validated implementation details for any live test.

Evidence access

Publisher abstract; full text may require access

SAGE publisher abstract retrieved with Firecrawl; the profile reports the retailer example and stated method benefits.

If only an abstract or metadata was available, the profile is limited to claims supported there. A paper's paywall does not change its evidentiary status, but it limits what we can substantiate from accessible text.

Prefer to write? Send Jon a message.