A key question about a system: does it work without LLMs?

Are LLMs just lubrication for the system?

Or are they the fundamental enabler?

LLMs are expensive and slow.

Systems that use them as lubrication can improve faster than the LLM.

Systems that can't work without the LLM are trapped by the LLM's performance.