When you have subtly wrong things in your LLM's knowledgebase, they compound.

· Bits and Bobs 4/27/26
  • When you have subtly wrong things in your LLM's knowledgebase, they compound.
    • The more energy you pump in, the. more it tears itself apart.
    • A small mistake allows a few more small mistakes on top of that misunderstanding.
    • Each one compounds and accumulates, and before you know it the whole system has torn itself apart.
    • This is similar to why allowing a single compile warning in your build quickly gets to a fundamentally messy state, or the concept behind broken windows policing.