LLMs are an "impossibly precocious ninth grader who never gets bored and has read 1000x more books than you ever will".

A lot of the party tricks LLMs can do are based on that last bit.

But that's also where the danger of LLMs lie, because they tend to hallucinate.

What if the first bit is more important, and you could get it more cheaply and with higher accuracy?

Patterns that use LLMs in this way, in small, safer-to-fail ways, as part of a larger system, might prove to be more resilient.