Acquisition and retention · Field experiment with retention, usage, and profit analysis
Does Customer Email Engagement Improve Profitability? Evidence from a Field Experiment in Subscription Service Retailing
Wang, Y., Lu, L. X., & Shi, P. (2022). Manufacturing & Service Operations Management, 24(5), 2703–2721.
Plain-English take
A one-month program with two emails increased five-month retention likelihood by 7.4%, lowered churn odds by 26.3%, and raised per-period service use by 7.0%. For your marketing: The core lesson is to evaluate lifecycle email against retention, usage, and margin by segment.
How much weight to give this
3.5/5 Useful evidence with meaningful caveats
The 1–5 evidence-check score is a practical reading aid, not a formal peer review or a probability that a conclusion is true. It combines design strength (2 points), sample reporting (1), comparison/control clarity (1), and how much of the paper could be checked (1). Access affects how confidently this directory can assess a study, not the study's underlying quality. Blinding is reported separately because it is not relevant to every design.
An experiment is useful for causal evidence, but the accessible profile does not establish random assignment.
A usable sample size is not stated in the profile's accessible source.
Experimental comparison is described; randomization or control details need checking in the paper.
This profile could be checked against an abstract or metadata, not the full paper.
Double-blind? Blinding is not reported in the source reviewed; that does not establish whether blinding was or was not used.
Research question
What the authors investigated
Does email engagement raise subscription retention and usage, and is it profitable for every subscriber segment?
Design
Field experiment at a subscription-service retailer, analyzing retention and consumption with survival and difference-in-differences methods.
Sample and setting
Subscribers of a large U.S. car-wash chain with tiered subscriptions and RFID-tracked visits.
Reported result
What the study found
A one-month program with two emails increased five-month retention likelihood by 7.4%, lowered churn odds by 26.3%, and raised per-period service use by 7.0%. Estimated profitability varied by subscriber tier and usage frequency; the authors recommend selectively targeting profitable groups.
This is a paraphrase of the source. Check the original paper for definitions, estimates, statistical uncertainty and analysis details.
Scope and transfer
Limitations to keep in view
A single physical subscription service; the abstract does not provide sample size or detailed randomization information. Segment profitability depends on this firm's service costs and customer behavior.
Possible founder application
The core lesson is to evaluate lifecycle email against retention, usage, and margin by segment. A message that lifts engagement can still lose money for some cohorts.
Evidence access
Publisher abstract; full text may require access
INFORMS publisher abstract retrieved with Firecrawl; results and segment-specific recommendation follow the abstract.
If only an abstract or metadata was available, the profile is limited to claims supported there. A paper's paywall does not change its evidentiary status, but it limits what we can substantiate from accessible text.