The danger of prompt injection grows super linearly as a thread gets longer.
- The danger of prompt injection grows super linearly as a thread gets longer.
- This arises arithmetically.
- The danger of prompt injection is that an earlier poisoned input affected a later action.
- As the thread grows in length, there are more messages that could have had poisoned inputs… and also more pairs of inputs to later actions.
- The probability that every message before wasn't prompt injected shrinks to the power of the number of messages.