Seeing like a model provider: look at every problem like an eval problem.

· Bits and Bobs 7/20/26
  • Seeing like a model provider: look at every problem like an eval problem.
    • The answer to every problem becomes "simply get a better model," and the tactic to do that is "simply devise a better eval."
    • Things that can't be eval'ed either are unknowable or unimportant.
      • They might as well not exist.
    • The model providers honestly think they'll solve the Lethal Trifecta of prompt injection and security by having better models.

More on this topic

From other episodes