If the web wasn't open then LLMs could never have been created in the first place.
If the web wasn't open then LLMs could never have been created in the first place.
1,841 mentions · 834 chunks · 141 episodes
If the web wasn't open then LLMs could never have been created in the first place.
...hat's possible. An ecosystem of emergent collective intelligence, lubricated by LLMs, is a super-linear business. The quality of the LLM sets the floor of what is possible. The floor that the collective intelligence can accrete on top...
... via bridges, then it's way more likely to be survivable. Software generated by LLMs today are little islands, isolated from everything else you want to do. LLMs can only do shitty software in the small (without a human significantly ...
Both The Algorithm and LLMs are ultimately powered by human decisions. The Algorithm here meaning any ranking function that relies on human interaction to rank an infinite feed....
LLMs could allow humans to think 10,000 times more. But whether that's a good thing depends on what they bother thinking about. Thinking about creating ad...
... it can be compelling on its own. But they also cement the wrong mental model: "LLMs are just like a person, but virtual." That vastly misunderstands what LLMs are, what they can do, how they could be used. LLMs are an alien brain. Th...
...ously useful in improving the capability of models. In the earlier micro-era of LLMs it was all about the scale of how much world knowledge you could cram in. Extremely capital intensive. It feels like we've topped out on that, and no...
Two very different approaches for LLMs now: 1) The 'Cloud Provider' model: commodity hosting of models. Compete on cost. The hosting is the point. The model is commodity. 2) The 'LLM Provi...
... also if all of the details were visible you'd be overwhelmed by it. Humans and LLMs would both struggle. A tangled mess of wiring between cells. Finally, when the medium to express your ideas has no opinion, it just ends up being "ju...
... doesn't have one. It takes on the shape of whatever container you put it into. LLMs are a natural ingredient for liquid software. We need better containers for liquid software. The chatbot UX is fuzzy but not liquid.
...y software in the small is now free, so instead of thinking "how can I make the LLMs coding output more like how we write software today", think "what can we now create given that this whole class of stuff is now free" You need a new ...
...ful people are the ones most liable to being tricked via social engineering. If LLMs weren't guidable, then they wouldn't be useful. So they have to be at least a little gullible.
LLMs are fundamentally exposed to the prompt injection problem. There's no containment boundary between the data and control planes.[aci] Unlike in SQL, t...
...med to do. They can only have a structural pre-existing weakness exploited. But LLMs are like helpful humans: super gullible.
Without humans in the loop LLMs just produce slop. Humans are the curatorial energy that help find the greatness amid the cacophony and extract it. The right answer is not "how to h...
LLMs are more a sociological phenomena[acu] than a technological one. LLMs are best thought of as sociological mirrors of human society, not technological...
Remember: we're at the "filming stage shows[adb]" stage with LLMs. In film, it took awhile to discover the power of montage, a particular superpower of the medium. We don't yet know what the particular superpower of...
The challenge with LLMs is often giving them the right context.[add][ade] It's not that they lack a baseline common sense, it's that they don't know anything about your part...
A simple trick to change how LLMs reason: every so often, inject "Wait, but " into the in-progress reasoning token stream[adf]. This forces the LLM to reflect on what it might have mi...
... any human... and also lacks some aspects of common sense. I see dialogues with LLMs as not a conversation but an act of co-creation, and a chatbot UX seems to undermine that, and foreclose[adi] on other interactions. An alternate UX ...