Stuart Russell: has a 2016 paper called The Physics of Text.

Words have meaning because people use them to communicate.

Every document in the world is linked together by a latent variable: the real world.

None of the LLMs have that property.

They say only utterances that seem plausible given the omnipresent but invisible real world in their training.