It's amazing how much competition there is for LLMs.

Everyone standardized on OpenAI's API, which allows fast switching between providers.

Whichever knowledgebase users store their data in for the LLM to use is very sticky.

The LLM matters less than the system that stores your data.

It just so happens that ChatGPT stores some state for users (e.g. memories) and is getting some stickiness… but it need not be the thing from the model providers.

It's totally possible that someone could use off-the-shelf models from the top providers and create the sticky, value-generating service.

The LLM providers in that world would be kind of like internet providers: behind the scenes with significant competition.