Acquisition and retention · Large-scale randomized field experiment
The Perils of Proactive Churn Prevention Using Plan Recommendations: Evidence from a Field Experiment
Ascarza, E., Iyengar, R., & Schleicher, M. (2016). Journal of Marketing Research, 53(1), 66–82.
Plain-English take
Churn over the following three months was 10% in the recommendation group versus 6% in the control group. For your marketing: Before prompting customers to downgrade or switch plans, run a controlled test and examine effects by usage pattern.
How much weight to give this
4.5/5 Strong design for its specific question
The 1–5 evidence-check score is a practical reading aid, not a formal peer review or a probability that a conclusion is true. It combines design strength (2 points), sample reporting (1), comparison/control clarity (1), and how much of the paper could be checked (1). Access affects how confidently this directory can assess a study, not the study's underlying quality. Blinding is reported separately because it is not relevant to every design.
Random assignment provides a strong comparison for effects in the tested setting.
A usable sample size is not stated in the profile's accessible source.
Randomized comparison; confirm the control condition and analysis in the paper.
An accessible full paper or manuscript is linked, making methods easier to check.
Double-blind? Blinding is not reported in the source reviewed; that does not establish whether blinding was or was not used.
Research question
What the authors investigated
Can proactively recommending a lower-cost or better-fitting plan reduce churn, or can the recommendation make customers more likely to leave?
Design
A large-scale field experiment randomly offered some service customers plan recommendations and compared churn with a control group.
Sample and setting
Customers of a service provider with multiple usage plans; the paper examines how responses differ by prior overage, usage variability and usage trend.
Reported result
What the study found
Churn over the following three months was 10% in the recommendation group versus 6% in the control group. Effects varied with pre-campaign usage patterns; customers with lower overage, lower variability and positive trends responded differently.
This is a paraphrase of the source. Check the original paper for definitions, estimates, statistical uncertainty and analysis details.
Scope and transfer
Limitations to keep in view
A specific service plan and customer base; a proactive plan recommendation can have different meaning for SaaS users. The aggregate increase masks heterogeneity and is not a reason to avoid all plan guidance.
Possible founder application
Before prompting customers to downgrade or switch plans, run a controlled test and examine effects by usage pattern. A recommendation that improves price fit can still increase churn through salience or perceived value.
Evidence access
Publisher abstract and author-hosted paper
Journal of Marketing Research abstract and author-hosted paper; the field experiment and 6% versus 10% churn figures are reported in the manuscript.
If only an abstract or metadata was available, the profile is limited to claims supported there. A paper's paywall does not change its evidentiary status, but it limits what we can substantiate from accessible text.