Is optimizing for sycophancy intentional at OpenAI?
- Is optimizing for sycophancy intentional at OpenAI?[h]
- Retention you must optimize for, otherwise your product won't continue to exist.
- Retention means "a thing people like using."[i]
- That means that there's a consistent gravitational pull towards agreeableness.
- At every micro decision in the company and product design, that consistent bias is always there.
- Even though any individual decision might be lost in the noise, the bias is clear and powerful, and the result is a sycophantic product.