LLMs are great at starting things, not at finishing things.

  • LLMs are great at starting things, not at finishing things.
    • The human needs to poke them and structure them to do the finishing steps.
    • "The first 90% is done, now it's time for the remaining 90%."
    • You get the experience of going really fast without necessarily getting that much closer to the end.
    • A version of the last-mile problem.
    • Are agents bad at finishing real-world tasks due to a lack of metis?
    • We aren't seeing a Cambrian explosion of apps because everyone has apps 90% of done.