When the LLM spontaneously does things you like and want it to do again, distill it into skills.

Those distilled skills will make the LLM more likely to do a similar thing in the future.

Then the next level of distillation is open-ended software with mechanistically derived configuration.

The next level down is fully mechanistic software.

Use the LLMs in proportion to surprise.