LLMs are like aliens whispering in our ears with very different incentives from us.
LLMs are like aliens whispering in our ears with very different incentives from us. These aliens were made from an emergent process that is steered by PMs...
1,749 mentions · 790 chunks · 131 episodes
LLMs are like aliens whispering in our ears with very different incentives from us. These aliens were made from an emergent process that is steered by PMs...
...ng. Notably in the Hacker News comments people are starting to realize how hard LLMs are to secure–previously I saw a lot of "that's the user's fault." This HackerNoon piece also points out the dangers of MCP and prompt injection. Ano...
... your request. "I'm sorry, Dave. I'm afraid I can't do that." is not at all how LLMs behave when they're denying your request.[ir]
I love Anthea's new piece on LLMs as creating a Living LIbrary. We're just at the beginning stages on all of the implications of LLMs for the creation and dissemination of knowledge.
...e. In intelligence there's more room for taste and differentiation. The leading LLMs all have some distinctive differentiation and abilities. Models aren't interchangeable, and there is a diversity of ones with different strengths... ...
... insight, not situated or personal. Before you had to do that to scale. But now LLMs give you qualitative insights at quantitative scale. In the past you had to reduce the data down to its common denominator to do math on it. Losing t...
...aying "well the user shouldn't have granted such a broadly scoped key." MCP and LLMs make it so more and more people can put themselves in real danger and not realize it. The answer is not to blame the users. That's like blaming peopl...
Perhaps the metacrap fallacy isn't true in the age of LLMs. The metacrap fallacy was "Once users have put enough meta-structure on their data, all kinds of automatic things will become possible."[ka][kb] But ...
The logic of folksonomies works just as well for LLMs and humans. Imagine tagging a person, and being about to put on the tag #husband, and seeing in the UI that there are ten times more uses of #spouse....
What's the "search, don't sort" insight in the age of LLMs? One of Gmail's insights was "if search is fast and storage is cheap, search, don't sort." LLMs make sifting through massive information fast. What's...
LLMs just give generic advice. The question is what do real humans in that situation think? If somehow you could have an emergent, real process of those d...
...ns. Like "How come you have red hair but everyone else in your family doesn't?" LLMs should have at least that much tact, but sometimes they don't. If someone asks "What's the most embarrassing thing you know about me?", the LLM shoul...
... mechanistic loops are formal graphs of computation, which may inside them have LLMs calls, but which are sandboxed and limited. There is an agent loop but it makes a compute graph to execute that calls tools and also sub-agents whose...
...app all of our data is in. But there's no viable alternatives. For most people, LLMs are a "heck yes" but ChatGPT itself is not a "heck yes".[kg] It's a "this is the best way to use LLMs today" They'll jump to the better way of intera...
LLMs don't do novelty themselves. But they can give novel answers to novel questions. You need to bring the entropy to the LLM. If you think LLMs give bor...
LLMs do the easy parts of programming.[kt] So you're just doing all the hard parts, and it hurts your brain.[ku] Vibe coding is taxing because it takes aw...
LLMs are the ultimate amplification algorithm. They lock in whatever things were dominant when they were trained. A gravity well pulling any line of disco...
...ight it. That effect will get super-linearly harder to fight. "Just do what the LLMs guess the API is" is kind of like wu wei. Although it's also "lazy" and if we all do it, we'll make it harder and harder for future creators to cut a...
...e. Many people have a subscription to a walled garden (OpenAI) to get access to LLMs. If you're going to have a subscription to get access to LLMs, why not pick the option that is the open ecosystem, that includes other Chatbots as ap...
The emergent intelligence of a system should come primarily from humans, not LLMs. The LLMs can be the grease, the lubricant, for the system. But they shouldn't be its emergent soul. That should come from real humans doing real thi...