Tokens are better spent on explore than exploit.

Exploring is about surprise, which means LLMs are great for it.

Exploiting starts off being about surprise, but as it gets dialed in on a given hill, becomes about efficiency.

Mechanistic software is orders of magnitude more efficient.

Luckily, LLMs can create mechanistic software for you!

LLMs can write mechanistic software well.