Joel Simon's Creative Exploration with Reasoning LLMs is interesting.
- Joel Simon's Creative Exploration with Reasoning LLMs is interesting.
- If you ask LLMs to be creative they converge to the mush average.
- But if you inject structured noise, for example by having it apply Oblique Strategies then they can be more creative.
- LLMs will always pull you to the average.
- So to diverge you have to give them divergent inputs.