Using LLMs to do a task is squishy, non-deterministic, and expensive.

· Bits and Bobs 7/6/26
  • Using LLMs to do a task is squishy, non-deterministic, and expensive.
    • But you can have them distill mechanistic software on demand.
    • Then you can sandblast it with agents to make the software more robust.
    • The sandblasting has marginal cost, but the software that is produced out the other side doesn't require marginal LLM cost.

More on this topic

From other episodes