Chatbots are like filming stage plays.
... are like filming stage plays. We're still waiting for the "montage" moment for LLMs. My vote for the montage capability is LLMs being able to create software.
1,598 mentions · 615 chunks · 117 episodes
... are like filming stage plays. We're still waiting for the "montage" moment for LLMs. My vote for the montage capability is LLMs being able to create software.
LLMs ability to create software is catastrophically powerful. We keep on discovering new orders of magnitude more powerful techniques for getting more val...
...de is not about code, it's about anything your computer can do. The ability for LLMs to create software, to do things.
...: GraphViz. Graphviz, when rendered, makes sense to humans to understand flows. LLMs can understand it based just on the markup. A boundary object for flow graphs between LLMs and humans.
...e a huge unlock with agents. They used to be hard to understand how to use, but LLMs are great at them. Giving agents isolation, so if they blow up something, they don't blow up everything else, allows them to move fast. A powerful pi...
LLMs help diffuse knowledge of a system faster. To open a restaurant requires navigating a bureaucratic maze. Talking to people who have done it before, s...
... number of important operations which we can perform without thinking of them." LLMs make orders of magnitude more ideas fit inside one mind.[jf]
...cially to make it not just usable but also safe) is a huge amount of work, that LLMs don't do a great job at unless you tell them to. You need to know to tell them to. Many of the vibe coded apps that succeed in the market get taken d...
Verification is the bottleneck for LLMs. Verifiers of taste, or of quality, or correctness.[ji] This is where humans typically still need to be in the loop.
...utually inscrutable. If they converge, you get a boring, over-saturated middle. LLMs converge their output. So now the middle of the distribution of output will be over-saturated. That will push out the differentiation to the tails. H...
...very different dynamic. Yet another way that the implicit frame of Chatbots as "LLMs as friends" is unsettling and potentially dangerous.
...n proportion to how many times it runs. The same is true for workflows that use LLMs. If it's going to run once, just have an LLM execute an english language prompt. But if you're going to run it thousands of times, have the LLM write...
...s the situation really does have a faster OODA loop than before. The ability fo LLMs to write software is truly a fundamental speed limit that has changed. If it's not you… is it the singularity?
Could and should are distinct. There are things that LLMs could do that you shouldn't do.
An excellent piece from Paul Kedrosky about LLMs shifting the baseline of ability.[jp] "Extraordinary outcomes can (seemingly) disappear when the baseline rises because everyone is better." A distil...
LLMs are meta-boundary objects. Boundary objects are things that can be understood by different specialties. They allow communicating between two types of...
An implicit assumption in LLMs: "loudest is truest." That is, the most valuable ideas are the ones most likely to be replicated in the training set, and thus to be supported most s...
Code is like a skeleton, LLMs are like muscle. Skeleton alone: precise structure that can't move. Muscle alone: quivering mass on the floor with no leverage. Put them together cor...
You need both code and LLMs to unpack the power of AI. Code is the skeleton. LLMs are the muscle. Most approaches today assume the LLM should be in charge over the code. But I t...
Two prompting strategies to help deal with LLMs' tendency to agree with you. LLMs have a bias towards confirming your position… which might mean you get bad results if you're wrong. One pattern is ...