LLMs feeding on their own output can become an auto-decohering rat's nest.
- LLMs feeding on their own output can become an auto-decohering rat's nest.
- Even if the LLM is right 90% of the time, if it builds on its outputs dozens of times the likelihood it's right is tiny.
- You need humans in the loop, cleaning, curating, steering.