Chat is not the right paradigm for LLM apps.

· Bits and Bobs 4/8/24

It's a natural first paradigm: it's inherently interactive, and includes the human in the loop to correct and guide.

"No, not like that, more like this…"

This feedback loop makes them viable even when the answers aren't perfect.

If you take a prompt that works great in a chat and jam it into an app shape it doesn't work, because there's no feedback loop if it does it wrong.

The edges are not soft and recoverable, they are hard and sharp.

Software today has hard, sharp edges. Not soft, malleable edges.

But chats have no structure; they have no permanence. Just an append-only transcript.

A better model is enchanted artifacts that you can chat with and modify.

Imagine a TODO list where many of the items on the list could expand into more actionable steps, and even in some cases self-execute?

Chats then become a special case of an append-only enchanted artifact.

More on this topic

From other episodes