The gold standard is a system that improves its quality the more it's used.

Self-ratcheting. Antifragile.

The system has to be open-ended. Able to absorb disconfirming evidence and new ideas to improve itself.

LLMs, as they exist today, cannot.

They are closed systems, sealed off at the time of training.

But you can still use the LLM's magic and wrap it in an open system that can self-ratchet in quality with use.

Another bit of evidence that the LLM is not The Thing, it's the enabler for The Thing.

LLMs are the missing magical ingredient that makes the new Thing possible.