The LLMs strip-mined content.
- The LLMs strip-mined content.
- They did it once to bootstrap the models.
- No thought of sustainability of content production.
- Search engines were kind of accidentally sustainable, since they delivered clicks to publishers that earned it.
- But LLMs just slurped it all up like the content was in the commons.
- The tragedy of the commons, but in many cases it wasn't even the commons.
- Just move fast and strip mine the content before anyone knows what's happening and can push back.
- The incentives for publishing have taken a nosedive.
- I'm glad we have these planetary-scale models but I wish they had been grown sustainably.