The LLM model providers are like electricity providers back when electricity was new.
- The LLM model providers are like electricity providers back when electricity was new.
- Competing to get better quality for cheaper.
- Innovating on new techniques to do so.
- But ultimately it will just become a commodity.
- No one will care where their tokens come from, if most providers have similar quality and don't store state.
- One place this metaphor breaks down is that power delivery infrastructure has a natural monopoly in a way that APIs don't.
- Atoms can be rivalrous, but bits don't have to be.