If in your UI at any point if there are multiple valid paths, ask a human to pick and note their preference.

Then if you can remember that choice for other users, too, then you get a system that continues to improve.

A self-improving system with the LLM and humans working in concert, better than either alone.

The LLM is great at coming up with mostly reasonable options quickly.

The human is great at applying judgment.