LLMs today are like a form of cooperative multi-tasking.

They assume that the conversation will proceed with orderly turn-taking.

Not too dissimilar from early versions of Mac OS, which required userland applications to proactively yield to other programs and allow them to run.