Systems that are hyper-scale will optimize for engagement.

That will focus on what we want, not what we want to want.

They will over time compete to optimize for our base desires, not our highest aspirations.

This is inescapable for hyper-scale single apps, but in a world with LLM's infinite sycophancy it's more dangerous than ever before.