When you use AI as load-bearing decisions in your business, you are at the mercy of the model provider.

Typically those decisions that require human-level judgment would be made by employees (or contractors) who are contractually obligated to optimize for the company.

But if they're being made by someone else's AI, then that someone else can make decisions that stop you cold.

"I'm sorry Dave, I'm afraid I can't do that."

The AI provider gets veto power over every aspect of your business.

It's kind of wild that in the HuggingFace attack by OpenAI, HuggingFace's use of the major models to defend against a cyberattack was vetoed by the model providers.

That's a particularly obvious example, but it will happen fractally at every level.