The models will try to eat their way up the stack.

The more that is built on top of them, the more they will use those conversation logs to improve the model quality and eat into those use cases.

The process scrapes away at the stuff above it, distilling it into the model itself.

Models distill from real-world examples.

We can use models to distill mechanistic software.