If it has to work for you completely, it can't have a personality.

2025-06-09 · Bits and Bobs 6/9/25

If it has to work for you completely, it can't have a personality.
- Because no other can never be fully aligned with you, there must be some separation.
- If it has its own perspective on the world, there's a principal agent problem.
- This gets especially pronounced if the agent is more powerful than you.
- "I can't do that, Dave."

More on this topic

From other episodes

Imagine, a "family back office as a service."2026-03-17
The Principal Agent Problem is a specific subclass of the broader Goodhart's Law phenomenon.2026-03-09
Ben Thompson says OpenAI does have a business model they aren't embracing: ads.2025-12-08
When you're stuck with something for life, you don't just give up as easily.2025-12-01
A big component of the principal agent problem is a timeline mismatch.2025-11-24
The collective vs individual alignment problem is the principal agent problem.2025-11-10
This week someone framed alignment to me as "minimizing agency cost, as defined in the principal agent problem."2025-08-04
If a CEO could direct a swarm of LLM clones of themselves, we'll expect more volatility in company performance.2025-07-07