Ludwig’s ghost

Ascension Burial Ground in Cambridge. In a nice coincidence, Frank Ramsey, the young genius who, as a teenager, first translated Wittgenstein’s Tractatus, is buried nearby.
Quote of the Day
”When you become famous, being famous becomes your profession.”
- James Carville
Musical alternative to the morning’s radio news
Scott Joplin | Solace | performed by Phillip Dyson
Not a piece I knew. Glad I found it.
Long Read of the Day
AI is destroying books to stop chatbots choking on their own slop
Last week’s Observer column.
Some months ago, online booksellers began to notice a dramatic uptick in business. Books published before 2022 were suddenly in demand. One seller interviewed by the 404 Media website went from selling maybe 20 books in a good week to suddenly selling hundreds. He was puzzled and slightly suspicious about this bonanza. The books he usually sold tended to be specialised and bought by schools and libraries. And his bulk orders in the past were inclined to reflect a sudden interest in a particular topic.
But the recent large orders were for books that had little in common except for one thing: they all had an ISBN (International Standard Book Number) – a unique publishing identifier. “There’s no rhyme or reason to it,” he said. “Also, there’s a total disregard for the price of the book. I’ve had some books that sold this way that were… greatly overpriced.”
Whoever was buying these books was clearly not price-sensitive. That’s because those deep-pocketed bibliophiles were an AI company. The most likely collector is Anthropic, which Wall Street thinks is closing in on a $1tn valuation and has form in the book-scanning business. Way back in 2024, it hired Tom Turvey, an executive who had been involved in the Google Books project, and put him in charge of “Project Panama” – a secret scheme to “destructively scan all the books in the world”. According to an internal document unsealed in a court case, the codename was chosen “because we don’t want it to be known that we are working on this”.
So what is “destructive scanning”? Basically, it’s nasty, brutal and quick. It means cutting a book apart in order to digitise it. You slice off the spine or use a heated solvent to dissolve the book’s binding glue, and separate it into loose single sheets that are fed through a high-speed scanner or automatic document feeder. And, having done this, you pulp or otherwise dispose of the paper.
To anyone who cares about books, it may seem barbaric. After all – as the Google Books project showed – it’s possible to digitise books without destroying them. But that requires time and care, two things entirely absent from the tech mindset. Companies such as Anthropic are in a hurry and their appetite is gargantuan.
An internal memo on “data acquisition opportunity” dated October 2024 said that “We still have room to grow our investment in Project Panama. There are ~40 million books available to purchase in the world. Given our current purchase parameters mainly around price, publishing quality, confidentiality, our serviceable obtainable market (SOM) is $[redacted]M. To date we have purchased redactedM books leaving a sizable [redacted]M left.” (Note: “M” equals millions.)
What lies behind this appetite? Answer: the fear of “model collapse”. Large language models (LLMs) are trained by ingesting every machine-readable text available online. But as they become more ubiquitous, more and more of the text those chatbots generate is itself ending up back online. Which means that newer generations of LLMs will be trained on data that includes much of this AI-generated output.
In other words, the machines could eventually wind up inhaling their own exhaust. This is not a good idea, even for computers, as the late computer scientist Ross Anderson and his colleagues pointed out in 2023. Their study of “the curse of recursion” found that “use of model-generated content in training causes irreversible defects in the resulting models”.
Avoiding the curse means finding some impeccable, machine-readable text that is unsullied by AI slop. And what better source of such glorious training data than books published before the slop started spewing after the launch of ChatGPT in November 2022.
Books, after all, are the prime example of accumulated knowledge packed into copy-edited, grammatical, lucid prose. They have, of course, one drawback: their lack of machine-readability. But to an engineer, that’s a mere technical problem. Books can be butchered and their valuable data scanned into the giant sausage machine of AI.
It’s a pity, obviously, that they have to be destroyed in the process. But then you can’t have a tech revolution without shattering some sentimental human illusions.
The Odyssey corner
The thing that fascinates me about the movie (which, Ironically, I haven’t seen) is the discourse around and about it that it has spawned. The next exhibit is Ezra Klein’s interesting take on it in the New York Times. It’s a 16-minute video but there’s also a transcript.
Klein’s main (and interesting) point is that Christopher Nolan has
smuggled the core of Judeo-Christian ethics into “The Odyssey.” Zeus’ law, in Nolan’s “Odyssey,” echoes Leviticus 19:34: “The foreigner residing among you must be treated as your native-born. Love them as yourself, for you were foreigners in Egypt.” It echoes Rabbi Hillel, who said: “What is hateful to you, do not do to your fellow. That is the whole Torah; the rest is commentary.” It echoes Matthew 7:12, when Jesus says, “In everything, do to others what you would have them do to you, for this sums up the law and the prophets.”
I asked Claude to explain the thinking behind this interpretation. Here’s how it responded:
Nolan’s Odysseus is a man living amid the wreckage tricksters have caused, forced to reckon with it. Klein argues we’re currently living through “an age of tricksters” (Musk, Trump, Tucker Carlson, etc.) — figures who gain power by transgressing norms and taboos. Nolan’s twist is smuggling Judeo-Christian ethics (the Golden Rule, “love the stranger as yourself”) into the film via “Zeus’s law,” which in the actual myth is a much narrower rule about hospitality, not compassion. That substitution is the film’s “trick”: it makes an old moral inheritance — reciprocity and compassion over domination — feel new and urgent again.
This Blog is also available as an email three days a week. If you think that might suit you better, why not subscribe? One email on Mondays, Wednesdays and Fridays delivered to your inbox at 5am UK time. It’s free, and you can always unsubscribe if you conclude your inbox is full enough already! >
















