My friend Ben Follington: "For cooking, models act like a chef but are actually just nerds for cookbooks."

"You can have detailed conversations about music to generate listening recommendations and it always sounds like it knows what I mean while discussing subtle aspects of the sound design or composition.

Then it'll recommend a song and I remember 'oh you don't actually know what music is.'"

LLMs can do a convincing job of acting like they understand experiential phenomena, but they only have ever seen the shadows in the cave.