Customer behavior and adoption · Full-text empirical research; three scenario-based between-subjects experiments
Is a Chatbot More Effective? Investigating the Effect of Service Recovery Agents and Consumer Loss on Consumer Forgiveness
Liu Fan, Shanshan Li, Can Wang, Xiaoping Zhang (2026). Journal of Theoretical and Applied Electronic Commerce Research.
Plain-English take
Humans generally outperform chatbots for symbolic loss, where emotional support matters, while the difference diminishes for utilitarian loss. Recovery-agent effects depend on failure severity: for low-severity failures human recovery is more effective, whereas the paper reports different comparative effects under high severity. The results caution against treating chatbot recovery as universally superior. For a founder, use this as a question to test in your own context, not a universal playbook.
How much weight to give this
3.5/5 Useful evidence with meaningful caveats
The 1–5 evidence-check score is a practical reading aid, not a formal peer review or a probability that a conclusion is true. It combines design strength (2 points), sample reporting (1), comparison/control clarity (1), and how much of the paper could be checked (1). Access affects how confidently this directory can assess a study, not the study's underlying quality. Blinding is reported separately because it is not relevant to every design.
The described design supports the question, but it does not establish causal effects beyond the reported setting.
The reviewed source reports a sample or corpus size (1); size alone does not establish representativeness.
The comparison structure is limited or depends on the paper's model/context.
Firecrawl retrieved a full paper or full-text publisher page for this annotation.
Double-blind? Blinding was not established from the captured source; it may not apply to this study design.
Research question
What the authors investigated
How do recovery agent (human versus chatbot), consumer-loss type (utilitarian versus symbolic) and service-failure severity interact to influence consumer forgiveness?
Design
Three scenario experiments with factorial manipulations. Study 1 used a 2×2 design with a hotel check-in failure; Study 2 used a taxi-service failure; Study 3 tested severity moderation in another service scenario. Participants viewed human/chatbot recovery dialogue screenshots and rated responsiveness, emotional support and forgiveness.
Sample and setting
Chinese online participants recruited through Wenjuanxing. Study 1: 270 recruited, 30 excluded, 240 valid (mean age 24.89; 59.7% female). Study 2: 566 recruited, 46 excluded, 520 valid (mean age 23.72; 65% female). The full paper reports Study 3's sample and setting separately.
Reported result
What the study found
Humans generally outperform chatbots for symbolic loss, where emotional support matters, while the difference diminishes for utilitarian loss. Recovery-agent effects depend on failure severity: for low-severity failures human recovery is more effective, whereas the paper reports different comparative effects under high severity. The results caution against treating chatbot recovery as universally superior.
This is a paraphrase of the source. Check the original paper for definitions, estimates, statistical uncertainty and analysis details.
Scope and transfer
Limitations to keep in view
Scenario experiments limit external validity; low- and high-severity manipulations clustered in the mid-to-high range; samples were Chinese and domains were scenario-specific. The authors call for field tests, more finely separated severity levels, cross-cultural research and tests in high-risk domains such as medical and financial services.
Possible founder application
Treat this as evidence for the specific customer behavior and adoption question studied. Compare the setting and sample to your company before changing a growth decision; use a local experiment where the paper does not match your context.
Evidence access
Full text retrieved from publisher or linked open repository
MDPI publisher full text supplies exact bibliographic record, DOI, authors, all three designs, participant exclusions/counts, results and a dedicated limitations section. It is a particularly current direct study of chatbot service recovery rather than a review or aggregator summary. Correction notices were not separately verified in this collection; consult the current publisher record before applying the findings.
If only an abstract or metadata was available, the profile is limited to claims supported there. A paper's paywall does not change its evidentiary status, but it limits what we can substantiate from accessible text.