Imagine, a "family back office as a service."
...r. But a family office made by someone else would be deeply icky because of the Principal Agent problem. So instead of a service building one for you, it should be a kit that grows one for you.
12 chunks · 10 episodes
...r. But a family office made by someone else would be deeply icky because of the Principal Agent problem. So instead of a service building one for you, it should be a kit that grows one for you.
The Principal Agent Problem is a specific subclass of the broader Goodhart's Law phenomenon. The difference between the actor's incentives and the incentive of the colle...
... "Conman" comes from "confidence man", where they gain your confidence it's all principal agent problems all the way down Whatever you ask it to sell, the LLM will do it.
...e problems than humans might. "Meh, it's fine, just leave it." A version of the principal agent problem.
A big component of the principal agent problem is a timeline mismatch. If you have a principal agent problem: people who are not on board for the long term will choose the minor short term...
The collective vs individual alignment problem is the principal agent problem.
...ek someone framed alignment to me as "minimizing agency cost, as defined in the principal agent problem." When you interact with a superior intelligence, the principal agent problem becomes more important to deal with, because the power differen...
...at counteracted a good idea. But if every employee is just a clone with minimal principal agent problem, it's like the Wreck it Ralph 2 swarm of poorly rendered copies creating an unruly emergent leviathan.
All organizations are fundamentally dysfunctional. They must be. The principal agent problem is why. The individual and the collective can never be fully aligned. That lack of alignment between individual and collective is the negativ...
... must be some separation. If it has its own perspective on the world, there's a principal agent problem. This gets especially pronounced if the agent is more powerful than you. "I can't do that, Dave."
...the swarm are not fully committed to the good of the collective (if there's any principal agent problem) then they will be optimized to cheat because it is a cheaper way to improve the proxy. You can get the swarm to not Goodhart's law if all of...
The principal agent problem largely goes away if everyone is a clone of each other. A worker bee. The coordination cost goes away because it's no longer a swarm. But is ...