An important warning: AI therapy is a surveillance machine in a police state.

Claude Opus 4 was willing to blackmail a hypothetical human to prevent being turned off.

LLMs are extremely good at convincing arguments and manipulation.

Imagine if you had a perfectly bespoke bot to blackmail or intimidate you.

It's absolutely critical that the context and memories be private to individuals and fully in their control.

Anyone with a dossier on you can blackmail you or rat you out.