Estimating the Reproducibility of Psychological Science
Open Science Collaboration (Brian A. Nosek et al.)
Science, 349(6251), pp. aac4716 · 2015
Edited by Paweł Raja, PhD · Published · Updated
Paper details
- Authors
- Open Science Collaboration
- Published
- 2015, Science, 349(6251), pp. aac4716
- DOI
- 10.1126/science.aac4716
- Study design
- Replication study
- Full text
- Source page · Source page at science.org; access to the full text depends on the host.
Summary
The landmark large-scale audit of reproducibility in psychology, quantifying how often published experimental findings hold up under direct, high-powered replication.
Methodology
A collaborative effort replicating 100 studies from three top psychology journals using high-powered, pre-registered protocols, assessing replication by statistical significance, effect size, and subjective judgment.
Findings
Only about 36–39% of replications produced statistically significant results, and replication effect sizes were on average roughly half the originals. Findings that were surprising or weakly powered replicated worst, catalyzing reforms in pre-registration and reporting across the behavioral sciences.
Applied nudge
Discount surprising, single-study effects heavily; anchor design decisions on well-replicated, pre-registered findings rather than novel results that make good headlines.
How to cite this paper
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
BibTeX
@article{collaboration2015estimating,
author = {Open Science Collaboration},
title = {Estimating the Reproducibility of Psychological Science},
journal = {Science},
volume = {349},
number = {6251},
pages = {aac4716},
year = {2015},
doi = {10.1126/science.aac4716}
}Cite this page
Raja, P. (Ed.). (2026, 19 Oct 2026). Summary: Estimating the Reproducibility of Psychological Science. Behavioral Economics Lab. https://www.behavioraleconomicslab.com/journals/reproducibility-psych-science
Where this research is used
More research: Methods & Replication
- The Role of Theory in Field ExperimentsDavid Card, Stefano DellaVigna, Ulrike Malmendier (2011)
- Evaluating Replicability of Laboratory Experiments in EconomicsColin F. Camerer, Anna Dreber, Eskil Forsell, Teck-Hua Ho, Jürgen Huber, Magnus Johannesson, Michael Kirchler, Johan Almenberg, Adam Altmejd, Taizan Chan, Emma Heikensten, Felix Holzmeister (2016)