LLMs are optimized for the superficial appearance of quality in their answers.
...tals. An interesting paper that examines this: Pareidolic Illusions of Meaning: ChatGPT Pseudolaw and the Triumph of Form over Substance.
195 mentions · 155 chunks · 67 episodes
...tals. An interesting paper that examines this: Pareidolic Illusions of Meaning: ChatGPT Pseudolaw and the Triumph of Form over Substance.
...ment. Sycophancy in chatbots is a thing that users want but don't want to want. ChatGPT's recent sycophancy problem was caused partly because of an over-reliance on thumbs-up responses on answers, which tend to naturally bias towards syc...
ChatGPT's new memory feature deliberately hides what it knows about you. That makes its context more of a dossier. See this tweet from someone who worked on ...
ChatGPT's memory feature refusing to tell you what it knows about you is inherently creepy and lampshades the misaligned incentives. "I'm sorry Dave, I can't...
...contain multitudes. In each vertical we're like a different person.[no] "Should ChatGPT remember this thing about me" is a contextual question. A single answer doesn't exist for it in general, it's "in what context"? An assistant having ...
Users are not roles. ChatGPT conflates the two. ChatGPT's memory context collapses our lives to a single context. We contain multitudes! Claude projects allows users to maintain ...
...hat system. I'd be very curious to see how the proportion of Temporary chats in ChatGPT changed after the introduction of the new memory feature.
Rohit got locked out of his OpenAI account. Imagine how bad that would be if ChatGPT were the operating system for your life.
The reaction to ChatGPT's new memory feature seems mixed. Chatbots previously had a fresh sheet of paper for each conversation. Kind of like a term limit; it can't develop p...
Alexa is not your assistant, it's Amazon's! Similarly, ChatGPT is not your assistant, it's OpenAI's. When Claude makes an artifact, it feels like it made something for you. You didn't make it, Claude did. Softwar...
The new ChatGPT model can include memories from previous conversations. Unlike the previous memory system, this one is impossible to directly audit or control. I fin...
...thing but completely inevitable that I was surprised by their surprise. I asked ChatGPT to prepare a Deep Research report on why it is and thought it did a pretty good job. The non-rivalrous nature of software and power of abstraction se...
Claude feels divergent, ChatGPT feels convergent. Claude is willing to follow you on whatever wild flight of fancy you have. "What an astute observation" to even the most ridiculous...
...n questions from this thread", and then pasting that summary into a new thread. ChatGPT has started adding features like "memories" but it seems half-baked[ys] and frustrating to use. Some memories I want the system to have are context-i...
...re's an alternate universe that is totally possible to imagine. OpenAI releases ChatGPT before they release any API. They don't ever release an API because it would be "dangerous" …and also undermine their app's differentiation and power...
ChatGPT could conceivably turn out to be prosumer, not consumer. More like Microsoft Word than Instagram.
...LLM matters less than the system that stores your data. It just so happens that ChatGPT stores some state for users (e.g. memories) and is getting some stickiness… but it need not be the thing from the model providers. It's totally possi...
... some friends shared with me. When driving somewhere with a kid in the car, ask ChatGPT, "Tell me about gas giants" and then help the kid ask follow-up questions. You can also ask ChatGPT to come up with some quiz questions for your kid ...
An interaction pattern I've seen people do in ChatGPT: named, thematic chats. The default style of use of ChatGPT (in my experience) is that every conversation is a new chat. A fresh sheet of paper, tota...
LLMs are inherently bland. If you ask ChatGPT to ask you an interesting question it'll say something super generic like: "What movie or book do you think everyone should read or see, and why?" LL...