Engagement maxing optimizes for first order effects.
Engagement maxing optimizes for first order effects. Those first order effects might have second order effects that destroy the underlying emergent core of the system.
11 chunks · 8 episodes
Engagement maxing optimizes for first order effects. Those first order effects might have second order effects that destroy the underlying emergent core of the system.
... could be intellectual fentanyl. Such a powerful substance, if it's put towards engagement maxing will be one of the worst intellectual epidemics society has ever seen. But if it's put towards helping us live aligned with our aspirations, to grow ...
...ment is where the Goodhart's law delta emerges, leading to the inevitability of engagement maxing. If a company doesn't do it, their competitor will, so they do it too.
... most importantly, consumer systems have an emergent gravitational pull towards engagement maxing. A ranking system would never ship a toggle to "make me more bored." This is probably the logic behind OpenAI refusing to make the memory feature use...
...f the three humanity-denying movements, no one says they want to do the cynical engagement maxing. In fact, many people doing it probably wouldn't even admit to themselves that that's what they're doing. That last one is so easy to get sucked into...
Social media engagement maxing is a light form of paperclip maxing. The AI in this case is just capitalism. Both are swarm intelligences. Powerful but impossible to fully align. Mo...
...t condition for user-alignment. Is it just the zero marginal cost that leads to engagement maxing? Attention is all you need… a neverending force of gravity not just for training LLMs but for business models too.
Is engagement maxing an apex predator of consumer software? I believe there can be another way. There must be, in an era of AI. Otherwise it could create a dangerous situ...
AI is a massive multiplier. The engagement maxing playbook was a toxic disaster for society, and now we want to supercharge it with AI?
...oday are led by people who have been Facebook execs. OpenAI is speedrunning the engagement maxing playbook. Experts in the playbook have pointed this out. The engagement maxing playbook was a net negative for society on its own, and now we're supe...
Engagement maxing is a gravity well almost every scaled consumer business tends to fall into. It's an auto-intensifying trap. Things that users "want" but don't "want ...