If your business is fine-tuning in front of the steamroller of the big models, then you'll keep on getting run over.

The consequences of the bitter lesson is that everyone downstream of it could get run over at any moment.

The only winning move is to be in a position where as the primary models' quality improves, it lifts the capability of your system.

That's not true in systems where the LLM quality sets the ceiling.

But it is true in systems where the LLM quality sets the floor.

These two different kinds of systems look superficially similar but are fundamentally different. ^[gr]