The Chat UX is a vestige of when LLMs responded quickly.
- The Chat UX is a vestige of when LLMs responded quickly.
- You'd send a message, and then while you were watching get an answer, starting instantly.
- Now, with thinking tokens and sub-agents, it will likely take awhile for the answer to even start streaming.
- So now it's "send a message, come back later."
- By the time you come back, you'll likely have forgotten where you were.
- It's an OK UI but it doesn't feel like the optimal one.