If you optimize hard for what's legible, you will reliably trade away a little of what's illegible each round.
- If you optimize hard for what's legible, you will reliably trade away a little of what's illegible each round.
- Nobody chooses that loss, it's simply what survives optimization.
- Your model must be a compression of reality in order to act.
- But that means there must be something your model leaves out.
- Humility and curiosity are the only real defense, since they're how you notice what your model leaves out.