Ben Thompson points out a limit with personal agents:

"That's the rub, though: the utility of an agent is still a function of how much effort you put into interacting with that agent, which itself is a function of understanding what the point is."

That's only if it can only do things you told it to do.

That's the only way for it to be even passably safe… but only in today's physics of trust.