Squishy bricks make for unstable buildings.
It's hard to make a mechanistic thing out of a squishy thing.
LLMs' power is precisely their squishiness.
Something made of smaller mechanistic pieces can be stacked on each other.
But a wobbly block of jelly on top of a wobbly jelly foundation compounds the wobbliness.
The wobbliness is a lack of commitment.
Commitments allow components to fit together.
Instead of having the squishy stuff on the outside and the deterministic stuff on the inside, flip it.
Have a deterministic outside with a squishy inside.