Skip to content
Methods & Replication

Estimating the Reproducibility of Psychological Science

Open Science Collaboration (Brian A. Nosek et al.)

Science, 349(6251), pp. aac4716 · 2015

Edited by Paweł Raja, PhD · Published · Updated

Paper details

Authors
Open Science Collaboration
Published
2015, Science, 349(6251), pp. aac4716
DOI
10.1126/science.aac4716
Study design
Replication study
Full text
Source page · Source page at science.org; access to the full text depends on the host.

Summary

The landmark large-scale audit of reproducibility in psychology, quantifying how often published experimental findings hold up under direct, high-powered replication.

Methodology

A collaborative effort replicating 100 studies from three top psychology journals using high-powered, pre-registered protocols, assessing replication by statistical significance, effect size, and subjective judgment.

Findings

Only about 36–39% of replications produced statistically significant results, and replication effect sizes were on average roughly half the originals. Findings that were surprising or weakly powered replicated worst, catalyzing reforms in pre-registration and reporting across the behavioral sciences.

Applied nudge

Discount surprising, single-study effects heavily; anchor design decisions on well-replicated, pre-registered findings rather than novel results that make good headlines.

How to cite this paper

Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716

BibTeX
@article{collaboration2015estimating,
  author = {Open Science Collaboration},
  title = {Estimating the Reproducibility of Psychological Science},
  journal = {Science},
  volume = {349},
  number = {6251},
  pages = {aac4716},
  year = {2015},
  doi = {10.1126/science.aac4716}
}

Cite this page

Raja, P. (Ed.). (2026, 19 Oct 2026). Summary: Estimating the Reproducibility of Psychological Science. Behavioral Economics Lab. https://www.behavioraleconomicslab.com/journals/reproducibility-psych-science

Where this research is used

More research: Methods & Replication