An LLM writing software for you today has to start from scratch each time.

If you could store the code that it had already written for it to use as building blocks, it could go much further.

You'd need some way of storing state in the system.

Even better: if the work the LLM did to write one user's software could automatically make it better at writing other users' software, too.