"Seems right, but is wrong" is often good enough for social positioning.

But it's not good enough in a ground truthed environment.

If you aren't being continuously ground-truthed (for example by a competitor) then everything appears to work, until one day, catastrophically, the barbarians storm the gates.