Thinking slowly allows you to reason deeper.

· Bits and Bobs 2/18/25
  • Thinking slowly allows you to reason deeper.
    • That's why System 2 built out of System 1 (i.e. the reasoning models) works.
    • The longer you reason, the further from the base "vibes" of the memory you can get.
    • How far you can go is not just about time, but about how much reasoning computation can happen.[yg]
    • You can argue that larger models, which go slower by default (or require more resources) can reason further away from the baseline.
    • But reasoning models move that scaling factor out of intrinsics of the model, to instead give open ended space to reason.