Before software had to be fractally mechanistic, all the way down.
- Before software had to be fractally mechanistic, all the way down.
- Now you can break it down to a level that an LLM can trivially answer.
- You don't have to recurse below that point.
- When you break down most judgment calls small enough you can clear the threshold where any LLM can answer it reasonably.
- LLMs are more expensive than mechanistic code, but much more flexible and able to handle variance.
- When you have a working amalgam of LLMs and mechanistic code, you can keep on tightening it, converting it to more and more mechanistic over time.
- For example, if you can factor out a mechanistic rule that covers 80% of last month's inputs to the LLM without going to the LLM, factor that out!
- The amount of tightening you can do is inversely proportional to the observed historic variance.