Skip to content
AI & Trust

Human Decisions and Machine Predictions

Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, Sendhil Mullainathan

The Quarterly Journal of Economics, 133(1), pp. 237-293 · 2018

Edited by Paweł Raja, PhD · Published · Updated

Paper details

Authors
Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, Sendhil Mullainathan
Published
2018, The Quarterly Journal of Economics, 133(1), pp. 237-293
DOI
10.1093/qje/qjx032
Study design
Observational / administrative data
Full text
Free PDF · Free PDF of the working-paper version (NBER Working Paper No. 23180), hosted at nber.org. Cite the published version and check page numbers against it.

Summary

Uses pretrial bail as a high-stakes test of whether machine-learning predictions can improve on human judges, while confronting the 'selective labels' problem that makes such comparisons hard.

Methodology

Builds a machine-learning model to predict a defendant's risk of failing to appear or reoffending using data available to judges, then evaluates policy simulations against actual judicial release decisions in New York City, carefully addressing the fact that outcomes are only observed for released defendants.

Findings

Algorithmic release rules could cut crime by up to about 24.7% with no increase in jail populations, or reduce jail populations by up to about 41.9% with no rise in crime. Judges misrank defendants and appear to overreact to salient but weakly predictive features, leaving large welfare gains on the table.

Applied nudge

Where consistent prediction beats human intuition, position the algorithm as the default recommendation and design the interface so experts override it only with cause—curbing noise-driven, salience-based deviations.

How to cite this paper

Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018). Human decisions and machine predictions. Quarterly Journal of Economics, 133(1), 237-293. https://doi.org/10.1093/qje/qjx032

Also circulated as NBER Working Paper No. 23180.

BibTeX
@article{kleinberg2018human,
  author = {Jon Kleinberg and Himabindu Lakkaraju and Jure Leskovec and Jens Ludwig and Sendhil Mullainathan},
  title = {Human Decisions and Machine Predictions},
  journal = {The Quarterly Journal of Economics},
  volume = {133},
  number = {1},
  pages = {237--293},
  year = {2018},
  doi = {10.1093/qje/qjx032}
}

Cite this page

Raja, P. (Ed.). (2026, 19 Oct 2026). Summary: Human Decisions and Machine Predictions. Behavioral Economics Lab. https://www.behavioraleconomicslab.com/journals/human-decisions-machine-predictions

Where this research is used

More research: AI & Trust