The language model is a component of an overall system.

When people imagine something like AGI, they imagine a specific high-powered computer, running a single, finely tuned model, blinking and beeping in a corner somewhere.

An alternate view from complex systems is to view the emergent totality of the surrounding system as where the intelligence lies.

Not just one model, but multiple interleaved in an emergent web of interactions and systems with real people, traditional computer systems, etc.

In this view, any individual model is merely a component.

The overall intelligence emerges from a fabric, more akin to the Technium than an engineered object sitting in a corner.

A gardener view vs a builder view.