If you presume a given model describes reality you'll structurally pay less attention to the things that don't fit the model.
- If you presume a given model describes reality you'll structurally pay less attention to the things that don't fit the model.
- That's precisely where the value and insight comes from!
- The surprisal is the gradient of learning.
- All models must be wrong–they need to distill complex reality by reducing dimensionality.
- But some models are useful.