LLMs can't forget about the context in their conversation, they are always drawn to it.
- LLMs can't forget about the context in their conversation, they are always drawn to it.
- So saying "come up with five different ideas and develop each" works very differently in one conversation vs if you mechanistically split it up into multiple conversations.