Only accepted work is recordedAboutGuidesContactSign in
CitePepCitePep
Understanding Goodhart's Law and Its Consequences
Correction Principles Laws

Understanding Goodhart's Law and Its Consequences

Corrected by Emir Baycan · on When Notes Fly · 15 November 2026 · View published page ↗

Goodhart's Law in his own 1975 words: any observed statistical regularity tends to collapse once pressure is placed upon it for control purposes.

Factually incorrect

The exact change

Before
A 2011 study by researchers at the RAND Corporation (Stecher et al., 2011) found that the divergence between state test score gains and NAEP gains was substantial and systematic, suggesting | A 2019 study by researchers at Leiden University (Waltman et al., 2019) documented how citation-based metrics had systematically distorted publication patterns across fields - incentivizing superficially citable work over fundamental research, and rewarding rapid publication over careful verification. | A 2012 analysis published in the British Medical Journal (Gao et al., 2012) found that while the four-hour target had succeeded in reducing formally measured wait times, evidence of parallel gaming behaviors was widespread.
After
A 2011 National Research Council committee, whose members included RAND's Brian Stecher, found that when progress was measured on low-stakes tests such as NAEP instead of the high-stakes state tests themselves, the gains shrank to about 0.08 standard deviations on average, suggesting | The 2015 Leiden Manifesto, published in Nature by Diana Hicks, Paul Wouters, Ludo Waltman, and colleagues, warned that research evaluation had become driven by metrics instead of expert judgement, and that indicators such as the h-index and the journal impact factor were being widely misapplied. | A 2006 analysis published in the British Medical Journal by Gwyn Bevan and Christopher Hood found that while targets such as the four-hour standard had succeeded in reducing formally measured wait times, there was also evidence of gaming.

Suggested change

Corrected 3 figures to the published source.

Why this is better

Each study and survey figure in the article was checked against the published source. Figures that differed from the source were corrected to the source's own numbers, dates and attribution.

More by Emir Baycan in Principles Laws

All of Emir Baycan's contributions →