The Chat UX is a vestige of when LLMs responded quickly.

· Bits and Bobs 8/31/26
  • The Chat UX is a vestige of when LLMs responded quickly.
    • You'd send a message, and then while you were watching get an answer, starting instantly.
    • Now, with thinking tokens and sub-agents, it will likely take awhile for the answer to even start streaming.
    • So now it's "send a message, come back later."
    • By the time you come back, you'll likely have forgotten where you were.
    • It's an OK UI but it doesn't feel like the optimal one.

More on this topic

From other episodes