Optimizers will choose gains on the target metric at catastrophic cost to unmeasured externalities.
- Optimizers will choose gains on the target metric at catastrophic cost to unmeasured externalities.
- Another way of describing the fundamental reason Goodhart's Law shows up.