Bobbin
  • Episodes
  • Summaries
  • Topics
  1. Episodes
  2. Bits and Bobs 6/3/24
  3. Surprisal gives us a gradient we can choose to follow.

Surprisal gives us a gradient we can choose to follow.

2024-06-03 · Bits and Bobs 6/3/24

More on this topic

From other episodes

  • Even (very) noisy LLM evaluators are useful for improving AI agents.2026-06-01
  • End-to-end encryption in messaging is now table stakes.2026-04-06
  • If a system is open but so different from everything else, it is effectively closed.2026-02-23
  • The gradient of competition can only give users what they want, not what they want to want.2025-12-08
  • If you follow the gradients of optimization you get what people "want" not what they "want to want."2025-11-24
  • There's a class of shortcuts that are good for the individual but bad for the collective.2025-11-17
  • Enshittification is inevitable for successful products.2025-11-10
  • It's not that Goodhart's Law just so happens to find shortcuts.2025-10-27
← Why do we fall into ruts so easily, as individuals and organizations?When you invest all your effort on one go into a moderate-size plan, if the plan doesn't work you're screwed. →

Topics

?
The main themes in this chunk.
  • gradient

Distinctive

?
Topics that stand out more in this episode than they usually do across Bobbin.
  • discretionary effort
  • background noise
  • massive amount

Related

?
Nearby or semantically related chunks worth branching to next.
  • If you follow the gradients of optimization you get what people "want" not what they "want to want."2025-11-24
  • There's a class of shortcuts that are good for the individual but bad for the collective.2025-11-17
  • Enshittification is inevitable for successful products.2025-11-10
  • It's not that Goodhart's Law just so happens to find shortcuts.2025-10-27

Bits and Bobs by Alex Komoroske