Every swarm has an emergent Goodhart's Law.

2026-03-09 · Bits and Bobs 3/9/26

Every swarm has an emergent Goodhart's Law.
- The individual player doesn't care about the collective so they take the edge to get a benefit.
- This happens to the extent the players don't have a strong shared belief in the collective.
- AI runs swarms even harder, which will lead to even more Goodhart's Law.
- That means shared beliefs will be even more important.

More on this topic

From other episodes

There's a class of shortcuts that are good for the individual but bad for the collective.2025-11-17
Optimizers will choose gains on the target metric at catastrophic cost to unmeasured externalities.2025-11-10
James Evans gave a fascinating talk I attended this week.2025-11-10
Hyper financialism is just Goodhart's Law.2025-11-04
Excellent piece from Ben Mathes on Goodhart's Law and "Lowest Common Consensus".2025-11-04
It's not that Goodhart's Law just so happens to find shortcuts.2025-10-27
Dimensions omitted from an optimization target will be set to the worst possible value.2025-10-27
Swarms are adaptable but have Goodhart's Law.2025-10-20