As context windows get larger, the default personality of models matters incrementally less.
- As context windows get larger, the default personality of models matters incrementally less.
- Imagine that the model has a baseline perspective, and it takes tokens to drag it in another direction.
- If you have 8k tokens of context (remember when that was all we had, just a couple of years ago?) you can't get very far.
- But with a million tokens, you can get very far.