A useful pattern for LLMs is the Ralph pattern.

As in Wiggum.

A very simple loop with the LLM with instructions to leave a checklist of proposed actions in the documentation.

It allows something like semantic fuzz testing.

Oddly, the LLM iterations can build up their own superstitions; one early run can leave a note for a future run that taints its understanding.