Ilya's assertion from many years ago "compression is intelligence."
...on is intelligence.[ag]" To successfully compress something, you have to have a predictive model of it.
11 chunks · 11 episodes
...on is intelligence.[ag]" To successfully compress something, you have to have a predictive model of it.
...y continuously distilling your intuition into formal structure until you have a predictive model.
...slow twitch time you're abducting new learning out of that error to have a more predictive model. Now that it's factored into the model, the next phase of fast execution gives you more leverage than you had before. This is similar to what our bra...
We are all babies in the Hyper age. Babies don't have a predictive model of the world. Everything is overwhelming: it's all blooming, buzzing confusion. We now live in the cacophonous Hyper age. Everyone is awash in bloomi...
For a tool to feel like an extension of you you must have a nearly fully predictive model of what it will do. The illusion of it being an extension of you only works if you feel you can control it with high precision. Every time you can't ...
... of the ancestral migrations in Australia. Apparently the two components of the predictive model for the path of the migrations are "least calories" but also "prominent visual landmarks to sight off:" In a big undifferentiated desert, having a cl...
... Let me try a slightly different derivation. Learning means developing a better predictive model of the world. Without error there is nothing in the model to correct. Correcting weights to produce a better model is literally what learning means. ...
To be surprised, you have to have an expectation; a predictive model (explicit or implicit). If you have no predictive model, it will all just be chaos, and there will be no surprise. Surprise is the raw material for l...
... more predictable in a way that is difficult to explain to others. An effective predictive model is one that can produce accurate predictions… and do so cheaply and quickly enough to actually be useful in practice. A participant who has an effect...
...is a great forcing function for you to understand the thing well enough to do a predictive model of it. (This line of reasoning originates with Peter Norvig, I believe.)
...t information, balancing across a lot of possibilities, developing an intuitive predictive model, and being ready to have a decision if someone said "OK, go time, make your decision RIGHT NOW". The two situations look somewhat similar externally ...