As context windows get larger, the default personality of models matters incrementally less.

· Bits and Bobs 4/13/26
  • As context windows get larger, the default personality of models matters incrementally less.
    • Imagine that the model has a baseline perspective, and it takes tokens to drag it in another direction.
    • If you have 8k tokens of context (remember when that was all we had, just a couple of years ago?) you can't get very far.
    • But with a million tokens, you can get very far.

More on this topic

From other episodes