LLMs are significantly cheaper if you only append the tokens.
LLMs are significantly cheaper if you only append the tokens. If you only append tokens, you can reuse the existing KVCache from earlier runs instead of h...
Topic: llms
1,749 mentions · 790 chunks · 131 episodes
184.9× distinctiveness vs baseline
?
How much more common this term is here than in ordinary English. Higher values mean the topic is more characteristic of this corpus.
1.5x burst in 2025 Q1
?
Peak quarter intensity across the topic's active span. Higher values mean attention was concentrated into a shorter stretch rather than spread evenly over time.
Topic summary
?
A short read on the topic's time range, peak episode, and strongest associations. Use it as the quick orientation before drilling into examples.
- llms appears in 790 chunks across 131 episodes, from 2023-11-06 to 2026-08-03.
- Its densest episode is Bits and Bobs 10/20/25 (2025-10-20), with 17 observations on this topic.
- Semantically it travels with ChatGPT, Claude, and Google, while by chunk count it sits between Claude; its yearly rank moved from #2 in 2023 to #1 in 2026.
Over time
?
Raw mentions over time. Use this to see absolute attention, not relative rank among all topics.
Observations
?
The primary evidence view for this topic. Sort it chronologically when you want concrete examples behind the larger pattern.
All of the labs would rather not have to give access to the top-of-the-line models via general API.
...ready released a completion API. The amount of value that can be extracted from LLMs is extremely variable in different verticals. A general-purpose API has to be priced at the median amount of value across verticals. But the amount o...
If you're below mean on a given dimension, LLMs pull you up.
If you're below mean on a given dimension, LLMs pull you up. If you're above, LLMs pull you down. Your own ability is not the global average. Your skill might be below the average quality, or above...
LLMs don't have an experience for others to resonate with.
LLMs don't have an experience for others to resonate with. LLMs are static and unable to learn. Also, they're a view from nowhere. That makes them hard fo...
It used to be that to test demand you made a doorbell in the jungle.
...if there were demand. That was because building products was expensive. But now LLMs make it trivial to make real software quickly. So now you can make a bungalow in the jungle to check for demand!
It's not a random happenstance that LLMs love filesystems and bash.
It's not a random happenstance that LLMs love filesystems and bash. Unix has three key design concepts: 1) Everything is a file[c]. 2) Commands should do one thing well. 3) Pipes connect dif...
If you want to automate, you have to either add structure or add intelligence.
... want to automate, you have to either add structure or add intelligence. Before LLMs, the former required humans to do the structuring. Before LLMs, the latter was impossible. Now you can do both!
Harnesses don't accrete meaningful state individually, but they do indirectly in the community.
... tied to that community. Of course, that also doesn't matter that much, because LLMs are so insanely good at translating from one domain to another.
What is the strategic staying power of our Google Accounts?
... used to be too much of a pain to extract our data into other services. But now LLMs could plausibly do the cognitive labor given a Google Takeout dump. The thing that would be hardest to leave is changing your gmail address for thous...
What is the system of record for software production?
...k matter star at the semantic center of the definition of the software. But now LLMs can translate from anything to anything. For the first time it's possible to have that meta-boundary-object of the actual software definition, in a l...
LLMs do the gilding better than the fundamentals.
LLMs do the gilding better than the fundamentals. Which makes sense; they're optimized for the superficial results. Quality is harder to judge than surfac...
When talking to LLMs you don't have to clean up your typos or worry about rambling or bouncing all over the place.
When talking to LLMs you don't have to clean up your typos or worry about rambling or bouncing all over the place. It's 100x lower difficulty than writing for another per...
There's a dimension separate from space and time: the semantic dimension.
... how it evolves and moves. Humans are absurdly sensitive to this dimension… and LLMs perhaps even more so, since they can do it at a scale humans can't. Humans live in linear time experientially in the moment, by requirement. LLMs liv...
LLMs are like a car.
LLMs are like a car. Whenever you want to go, it will take you. LLM helps you be productive but if it's self referential it escapes the ground truth. If y...
As a software provider, are you selling the software, or the thing the software accomplishes?
...re accomplishes? If the former, then your business is now worth much less given LLMs. If the latter, then there's no problem, and it's possibly even good.[w][x]
Improving the software production cycle with LLMs is like trying to add a new room to a house that is on fire.
Improving the software production cycle with LLMs is like trying to add a new room to a house that is on fire. The fundamentals of how software gets created are being reorganized as we watch.
"Judgement calls" require different answers from different actors.
...judgment call" then it's not a judgment call, it's straightforward and obvious. LLMs are great at tasks that nearly everyone (with enough time and motivation) would agree on. Humans often get bored, but LLMs have infinite patience. Th...
You can give agents a "personality hash" so they know how to work with you.
You can give agents a "personality hash"[ac] so they know how to work with you. LLMs are excellent at understanding the meaning of arcane jargon. One thing LLMs know well are enneagram types and Myer's Brigg personality types. "Alex i...
A lot of coordination costs inside of organizations are not about "is this a feature we want to support long term" but "is this worth even spending the time to think about?"
...o support long term" but "is this worth even spending the time to think about?" LLMs can help with the latter, not the former. If you can free up useless energy by automating it, you can spend that energy on higher-leverage things. "W...
Tedium is now free.
...ee. If you can break a complicated problem down into merely-tedious components, LLMs can do it.