Three pace layers of prototyping with LLMs:
- Three pace layers of prototyping with LLMs:
- 1) The LLM does everything.
- Expensive, loosey-goosey, flexible
- 2) The LLM behavior is sublimated into a mechanistic harness that can be run inside of other systems.
- Normal code that calls out to LLMs within itself.
- 3) The LLM creates mechanistic behavior that can be executed unless something needs to be changed.
- For example, the LLM creates a list of regular expressions to execute on inputs.