The tech industry is Goodhart's law-ing society.
... default case. The individual and the collective can never have their interests perfectly aligned.
10 chunks · 9 episodes
... default case. The individual and the collective can never have their interests perfectly aligned.
...s impossible for the incentives of the collective and the individual to ever be perfectly aligned.
The interests of the collective and of the individual cannot ever be perfectly aligned. It's a structural impossibility. You could get asymptotically close to aligned in some circumstances, but never perfectly aligned. There's always a ...
...ganization can be seen for what it is, a collection of sub-entities that aren't perfectly aligned. That can never be perfectly aligned with the collective. Outside the boundary you only see the external API, not the internal complexity. If you cou...
...u want to want and what you want must be disjoint to some degree, they can't be perfectly aligned. That misalignment is where the Goodhart's law delta emerges, leading to the inevitability of engagement maxing. If a company doesn't do it, their co...
...em look like that was balanced to the benefit of the user? Suggestions that are perfectly aligned with users' incentives would be much better than advertising for end users. But also pretty good for advertisers, too, because it would be so aligned...
... debunking… but also bunking. So if it has intimate knowledge of you and is not perfectly aligned (an impossibility) you get Goodhart's Law. An epic, society-scale monkey's paw. Hold on to your butts!
I want Intentional Tech. Technology that is perfectly aligned with my intentions. Not optimizing for anyone else, (especially a corporation), but for me. Not necessarily what I do but what I intend to do. My hig...
...e and with human agency. Prosocial. Aspirational and community minded. Private. Perfectly aligned with the human's interests. Meaningful. Not about engagement.
... of giving something autonomous agency to operate on your behalf. If you aren't perfectly aligned, watch out! Perfect alignment between two entities isn't possible[aai][aaj]. Agents are like the monkey's paw of wish granting. Be careful what you w...