A year ago: "Who could ever need more than 200,000 tokens???"

· Bits and Bobs 9/9/24

And yet today every day I run into context / conversation length limits in my Claude chats that use projects that I've crammed full of background context.

LLMs do better the more context they have to work with.

People will cram contexts as full as the LLM will let them.

More on this topic

From other episodes