The context and the LLM you use should be separate.
- The context and the LLM you use should be separate.[mz]
- If your context is locked to one model then you can't swap them out, and then you can't try other ones
- That leads to a strong centralizing force.
- The risk of a monopoly of models and services: a single world view that everyone is pulled towards, intentionally or unintentionally.
- Why might context portability happen now when it didn't before?
- LLMs are the most intimate technology ever, the stakes have never been higher.
- The hard part of interoperability is coordinating on schemas, but that problem evaporates with LLMs.