Skip to content
Methods & Replication

Evaluating Replicability of Laboratory Experiments in Economics

Colin F. Camerer, Anna Dreber, Eskil Forsell, et al.

Science, 351(6280), pp. 1433-1436 · 2016

Edited by Paweł Raja, PhD · Published · Updated

Paper details

Authors
Colin F. Camerer, Anna Dreber, Eskil Forsell, Teck-Hua Ho, Jürgen Huber, Magnus Johannesson, Michael Kirchler, Johan Almenberg, Adam Altmejd, Taizan Chan, Emma Heikensten, Felix Holzmeister
Published
2016, Science, 351(6280), pp. 1433-1436
DOI
10.1126/science.aaf0918
Study design
Replication study
Full text
Free PDF · Free PDF of the working-paper version (MPRA Paper No. 75461), hosted at mpra.ub.uni-muenchen.de. Cite the published version and check page numbers against it.

Summary

Provides the first systematic estimate of how well experimental-economics findings replicate, addressing the field's exposure to the broader 'replication crisis' in the social sciences.

Methodology

Pre-registered high-powered replications of 18 laboratory experiments published in two leading economics journals, with replication success judged by significant effects in the same direction and by effect-size comparison.

Findings

A significant effect in the original direction replicated in about 61% of studies (11 of 18), with replicated effect sizes averaging about two-thirds (66%) of the originals—higher than contemporaneous psychology replication rates but still leaving a substantial share unconfirmed.

Applied nudge

Treat a single published effect as provisional evidence; weight interventions by replication strength and run your own high-powered test before betting a product decision on a headline result.

How to cite this paper

Camerer, C. F., Dreber, A., Forsell, E., et al. (2016). Evaluating replicability of laboratory experiments in economics. Science, 351(6280), 1433-1436. https://doi.org/10.1126/science.aaf0918

Also circulated as MPRA Paper No. 75461.

BibTeX
@article{camerer2016evaluating,
  author = {Colin F. Camerer and Anna Dreber and Eskil Forsell and Teck-Hua Ho and Jürgen Huber and Magnus Johannesson and Michael Kirchler and Johan Almenberg and Adam Altmejd and Taizan Chan and Emma Heikensten and Felix Holzmeister},
  title = {Evaluating Replicability of Laboratory Experiments in Economics},
  journal = {Science},
  volume = {351},
  number = {6280},
  pages = {1433--1436},
  year = {2016},
  doi = {10.1126/science.aaf0918}
}

Cite this page

Raja, P. (Ed.). (2026, 19 Oct 2026). Summary: Evaluating Replicability of Laboratory Experiments in Economics. Behavioral Economics Lab. https://www.behavioraleconomicslab.com/journals/replicability-econ-experiments

Where this research is used

More research: Methods & Replication