Human Decisions and Machine Predictions
Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, Sendhil Mullainathan
The Quarterly Journal of Economics, 133(1), pp. 237-293 · 2018
Edited by Paweł Raja, PhD · Published · Updated
Paper details
- Authors
- Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, Sendhil Mullainathan
- Published
- 2018, The Quarterly Journal of Economics, 133(1), pp. 237-293
- DOI
- 10.1093/qje/qjx032
- Study design
- Observational / administrative data
- Full text
- Free PDF · Free PDF of the working-paper version (NBER Working Paper No. 23180), hosted at nber.org. Cite the published version and check page numbers against it.
Summary
Uses pretrial bail as a high-stakes test of whether machine-learning predictions can improve on human judges, while confronting the 'selective labels' problem that makes such comparisons hard.
Methodology
Builds a machine-learning model to predict a defendant's risk of failing to appear or reoffending using data available to judges, then evaluates policy simulations against actual judicial release decisions in New York City, carefully addressing the fact that outcomes are only observed for released defendants.
Findings
Algorithmic release rules could cut crime by up to about 24.7% with no increase in jail populations, or reduce jail populations by up to about 41.9% with no rise in crime. Judges misrank defendants and appear to overreact to salient but weakly predictive features, leaving large welfare gains on the table.
Applied nudge
Where consistent prediction beats human intuition, position the algorithm as the default recommendation and design the interface so experts override it only with cause—curbing noise-driven, salience-based deviations.
How to cite this paper
Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., & Mullainathan, S. (2018). Human decisions and machine predictions. Quarterly Journal of Economics, 133(1), 237-293. https://doi.org/10.1093/qje/qjx032
Also circulated as NBER Working Paper No. 23180.
BibTeX
@article{kleinberg2018human,
author = {Jon Kleinberg and Himabindu Lakkaraju and Jure Leskovec and Jens Ludwig and Sendhil Mullainathan},
title = {Human Decisions and Machine Predictions},
journal = {The Quarterly Journal of Economics},
volume = {133},
number = {1},
pages = {237--293},
year = {2018},
doi = {10.1093/qje/qjx032}
}Cite this page
Raja, P. (Ed.). (2026, 19 Oct 2026). Summary: Human Decisions and Machine Predictions. Behavioral Economics Lab. https://www.behavioraleconomicslab.com/journals/human-decisions-machine-predictions
Where this research is used
More research: AI & Trust
- Combining Human Expertise with Artificial Intelligence: Experimental Evidence from RadiologyNikhil Agarwal, Alex Moehring, Pranav Rajpurkar, Tobias Salz (2023)
- Algorithm Aversion: People Erroneously Avoid Algorithms After Seeing Them ErrBerkeley J. Dietvorst, Joseph P. Simmons, Cade Massey (2015)
- Algorithm Appreciation: People Prefer Algorithmic to Human JudgmentJennifer M. Logg, Julia A. Minson, Don A. Moore (2019)
- Human Trust in Artificial Intelligence: Review of Empirical ResearchElla Glikson, Anita Williams Woolley (2020)