Systems with humans embedded are more resilient.

Many finance jobs from back in the day are now handled by a spreadsheet cell.

This creates extraordinary efficiency that allows massive leverage, making whole new classes of things viable.

But it also loses something: the human judgment in the loop.

"This is way off from what it normally is... let me show my manager just in case."

An org made of people is a living thing in a way a spreadsheet is not.

A spreadsheet and an organization might have similar output in typical conditions.

But the org will handle anomalous situations much better.

If you only see them both operating during normal conditions, you'll erroneously assume they're mostly the same.

Having a system that includes humans embedded throughout it is way more resilient than one that does not.

At the early stages of AI-based experiences, we'll want humans in the system, tinkering, tweaking, responding, interacting.