LLMs scramble the cost equation of software.

Before, software was expensive to write, cheap to run.

But now LLMs make software much cheaper to write.

At least, for mini, disposable software.

And LLMs also are a new kind of ingredient in software that can make it magic.

But software that uses LLMs to execute is quite expensive to run!

Software used to be expensive to write, cheap to run.

Now it's relatively cheaper to write, relatively more expensive to run.

This flips a number of foundational assumptions in our industry on their heads!

A pattern for software that is cheap to write and cheap to run:

Use an LLM to write and configure the software.

But ensure that the configured software doesn't require any LLMs to execute.

You only need to use the LLM in proportion to how often the software needs to change, not how often it needs to run.