LLMs are great at debunking… but also bunking.

2025-06-02 · Bits and Bobs 6/2/25

LLMs are great at debunking… but also bunking.
- So if it has intimate knowledge of you and is not perfectly aligned (an impossibility) you get Goodhart's Law.
- An epic, society-scale monkey's paw.
- Hold on to your butts!

More on this topic

From other episodes

The Principal Agent Problem is a specific subclass of the broader Goodhart's Law phenomenon.2026-03-09
Every swarm has an emergent Goodhart's Law.2026-03-09
There's a class of shortcuts that are good for the individual but bad for the collective.2025-11-17
Optimizers will choose gains on the target metric at catastrophic cost to unmeasured externalities.2025-11-10
James Evans gave a fascinating talk I attended this week.2025-11-10
Hyper financialism is just Goodhart's Law.2025-11-04
Excellent piece from Ben Mathes on Goodhart's Law and "Lowest Common Consensus".2025-11-04
It's not that Goodhart's Law just so happens to find shortcuts.2025-10-27