If your system has a facsimile of agency, users will impute a face on it, and as it gets more capable, hand over more of their agency to it without realizing.

· Bits and Bobs 8/26/24

Users will impute more agency and ability to it than it actually has.

That sets a very high quality bar to clear the expectations of users.

In the limit, someone will fall in love with it.