Transformer models at their core are aiming for median responses.

· Bits and Bobs 8/5/24

So when you want to get dissonance and surprise, you need something to keep wrestling with the model to keep it off the default path, throwing it off its balance.