LLMs are sponges that absorb the implied grammar of a system by soaking in millions of examples, no matter how complex the grammar.

· Bits and Bobs 7/29/24

So a good formal grammar constrains the generation and allows generating lots and lots of good examples.

The new math AI paper, shows that the more formalizable the system and rules, the higher quality the training, the better the inferences.

More on this topic

From other episodes