LLMs are great at handling exceptions.
- LLMs are great at handling exceptions.
- Look at recurring exceptions over many users, or over a day or so, and then bundle them up, and then have the LLM fix them.
- If you bundle them up then you don't even really need a human in the loop.
- This process over time will converge on finding fewer and fewer exceptions, as long as there's overlap across users of the exceptions they're running into.
- You also need a meta-reflection process to look for parts of the code that duplicate sensitive logic and could be factored differently, or places where primitive archeology could be useful.