It used to be that programming "spells" could only create normal objects.

Normal software is like a wind-up toy, an automaton.

Just does precisely what it was told to do, no judgment.

Cheap to execute!

But now software can also use LLMs in its execution.

LLMs are like magic in software.

Software with an LLM inside is squishy, alive, emergent but also a bit unpredictable.

An LLM can use its judgment, which the user might not want.

A little bit of LLM magic enchants a bit of software. A lot gives it something that looks like its own agency.

LLMs can produce both plain old automaton software, or magical and alive software.