Evaluating Replicability of Laboratory Experiments in Economics
Colin F. Camerer, Anna Dreber, Eskil Forsell, et al.
Science, 351(6280), pp. 1433-1436 · 2016
Edited by Paweł Raja, PhD · Published · Updated
Paper details
- Authors
- Colin F. Camerer, Anna Dreber, Eskil Forsell, Teck-Hua Ho, Jürgen Huber, Magnus Johannesson, Michael Kirchler, Johan Almenberg, Adam Altmejd, Taizan Chan, Emma Heikensten, Felix Holzmeister
- Published
- 2016, Science, 351(6280), pp. 1433-1436
- DOI
- 10.1126/science.aaf0918
- Study design
- Replication study
- Full text
- Free PDF · Free PDF of the working-paper version (MPRA Paper No. 75461), hosted at mpra.ub.uni-muenchen.de. Cite the published version and check page numbers against it.
Summary
Provides the first systematic estimate of how well experimental-economics findings replicate, addressing the field's exposure to the broader 'replication crisis' in the social sciences.
Methodology
Pre-registered high-powered replications of 18 laboratory experiments published in two leading economics journals, with replication success judged by significant effects in the same direction and by effect-size comparison.
Findings
A significant effect in the original direction replicated in about 61% of studies (11 of 18), with replicated effect sizes averaging about two-thirds (66%) of the originals—higher than contemporaneous psychology replication rates but still leaving a substantial share unconfirmed.
Applied nudge
Treat a single published effect as provisional evidence; weight interventions by replication strength and run your own high-powered test before betting a product decision on a headline result.
How to cite this paper
Camerer, C. F., Dreber, A., Forsell, E., et al. (2016). Evaluating replicability of laboratory experiments in economics. Science, 351(6280), 1433-1436. https://doi.org/10.1126/science.aaf0918
Also circulated as MPRA Paper No. 75461.
BibTeX
@article{camerer2016evaluating,
author = {Colin F. Camerer and Anna Dreber and Eskil Forsell and Teck-Hua Ho and Jürgen Huber and Magnus Johannesson and Michael Kirchler and Johan Almenberg and Adam Altmejd and Taizan Chan and Emma Heikensten and Felix Holzmeister},
title = {Evaluating Replicability of Laboratory Experiments in Economics},
journal = {Science},
volume = {351},
number = {6280},
pages = {1433--1436},
year = {2016},
doi = {10.1126/science.aaf0918}
}Cite this page
Raja, P. (Ed.). (2026, 19 Oct 2026). Summary: Evaluating Replicability of Laboratory Experiments in Economics. Behavioral Economics Lab. https://www.behavioraleconomicslab.com/journals/replicability-econ-experiments
Where this research is used
More research: Methods & Replication
- Estimating the Reproducibility of Psychological ScienceOpen Science Collaboration (2015)
- The Role of Theory in Field ExperimentsDavid Card, Stefano DellaVigna, Ulrike Malmendier (2011)