Paid media and measurement · Large-scale randomized field experiment and heterogeneous-treatment analysis
Personalizing Ad Load to Optimize Subscription and Ad Revenues: Product Strategies Constructed from Experiments on Pandora
Goli, A., Reiley, D. H., & Zhang, H. (2025). Marketing Science, 44(2), 327–352.
Plain-English take
Consumption responses took more than a year to stabilize, while subscription responses stabilized in under six months. For your marketing: This shows why ad load can have delayed effects and why short tests may miss them.
How much weight to give this
4.0/5 Useful evidence with meaningful caveats
The 1–5 evidence-check score is a practical reading aid, not a formal peer review or a probability that a conclusion is true. It combines design strength (2 points), sample reporting (1), comparison/control clarity (1), and how much of the paper could be checked (1). Access affects how confidently this directory can assess a study, not the study's underlying quality. Blinding is reported separately because it is not relevant to every design.
Random assignment provides a strong comparison for effects in the tested setting.
A usable sample size is not stated in the profile's accessible source.
Randomized comparison; confirm the control condition and analysis in the paper.
This profile could be checked against an abstract or metadata, not the full paper.
Double-blind? Blinding is not reported in the source reviewed; that does not establish whether blinding was or was not used.
Research question
What the authors investigated
Can ad load be personalized to improve subscription and advertising revenue, and how quickly do users respond?
Design
Field experiment varying the number of ads per hour, followed by modeling of heterogeneous impacts and alternative allocation policies.
Sample and setting
More than seven million Pandora users in an 18-month experiment.
Reported result
What the study found
Consumption responses took more than a year to stabilize, while subscription responses stabilized in under six months. A personalized allocation was estimated to raise subscription profits by 7% without reducing ad profits; the modeled strategy lowered average consumer welfare by 2%.
This is a paraphrase of the source. Check the original paper for definitions, estimates, statistical uncertainty and analysis details.
Scope and transfer
Limitations to keep in view
A single audio-streaming platform and its advertising/subscription economics. The personalized policy results are model-based extrapolations from the experiment, and the reported welfare effect is a platform-specific estimate.
Possible founder application
Shows why ad load can have delayed effects and why short tests may miss them. Treat the numbers as a measurement-design example, not a target for SaaS paywalls or sponsorship inventory.
Evidence access
Publisher abstract; full text may require access
INFORMS publisher page and abstract retrieved with Firecrawl; no full text inspected for this profile.
If only an abstract or metadata was available, the profile is limited to claims supported there. A paper's paywall does not change its evidentiary status, but it limits what we can substantiate from accessible text.