I liked this essay about LLMs are weird computers.
- I liked this essay about LLMs are weird computers.
- Normal programs can't write a sonnet to save its life.
- LLMs can't give you the same results repeatedly to save its life.
- Deterministic vs non-deterministic computers have different strengths.
- System 1: powerful and deterministic but finicky.
- Mechanistic.
- System 2: broad and stochastic but forgiving.
- Emergent.
- Humans have Systems 1 and 2, and so do computers now.
- Though funnily enough which system is expensive and which is cheap is flipped for humans and computers.
- The future is obviously the combination of both system 1 and system 2, not either or.