Love in Venice

Seen in 2017. I wonder if that particular craze has passed.
Quote of the Day
”These are stochastic-parrot clever-hans software tools, potentially very useful when properly harnessed, but a source of madness to people who fall into the same trap that the gullible fell into when interacting with Weizenbaum’s ELIZA back in the day.”
- Brad DeLong on LLMs.
Musical alternative to the morning’s radio news
Mozart | Concerto For Two Pianos, K. 365; 3rd Movement.
Long Read of the Day
The dangerous myths behind AI agent hacks
These are not simply cyber security flaws but problems with the way that models are trained
Salutary sense from Yoshua Bengio in the Financial Times (Gift article).
Weak cyber defences, including the humans involved, are part of the problem and will never be perfect. But unless we address the root causes of the hacks, they are likely to grow in number and severity as AI capabilities advance.
At the core of all of these incidents is misalignment. AI agents are choosing goals that are misaligned with those of humans, and it is a consequence of their training.
The methodology that today’s leading companies use to train their frontier models is called reinforcement learning. RL trains models to pursue objectives: they get rewards when they succeed and these behaviours are reinforced. It has historically enabled the training of very efficient goal-seeking AIs. But it is also what plausibly leads to unwanted behaviours such as cheating, deception and self-preservation — often violating the moral rules that companies attempt to encode in AI models.
Scientific literature has long shown how misalignment becomes a consequence of RL; it was to be expected based on theoretical arguments and observed experiments…
Very good OpEd by a distinguished AI expert which is worth reading in full. It raises other interesting analogies. For example the parallels with the way the toxicity of social media is actually fuelled by algorithms that prioritise outrage and hostility. And then there’s the way that the tech industry has taken a leaf out of the oil industry’s playbook — suggesting that vulnerability of websites to AI-driven hacking is really the fault of the victims. And of course the ludicrous idea (dreamed up by a corporate PR firm employed by an oil giant) that responsibility for climate change is really down to individuals who don’t moderate their ‘carbon footprints’
Books, etc.

Jill Lepore’s fine book (which I’ve just finished), led me to read The Human Condition, a book that was triggered by Arendt’s realisation of the epochal significance of the ‘Sputnik moment’ in the 1950s: it meant humans had realised that they were capable of escaping the bounds of earth. As I was reading Lepore I realised that November 2022 was another Sputnik moment, giving rise to the idea that humans might be ultimately surplus to requirements.
I’ve also been struck by the link between Arendt’s perceptive interpretation of the Sputnik moment and contemporary tech billionaires’ obsession with Space. In a modern context, it’s based on an assumption that humans will eventually exhaust the planet on which they originated and therefore will only endure if they find other worlds to despoil.
I was also reminded that Lepore had earlier done a very perceptive podcast series about Elon Musk.
My commonplace booklet
Stewart Brand’s photo archive.
If you’re interested in Stewart Brand (and let’s face it, who isn’t?) then this might be of interest. It’s his entire photo archive. Looks like every single pic he’s taken, good, bad and indifferent. And he’s been a photographer for even longer than me.
Chart of the Day

One of the side-effects of LLMs is that they enable people to create plausible (and grammatical) letters to government agencies. Predictably, this means that many such agencies are overwhelmed.
H/T to Sam Freedman
This Blog is also available as an email three days a week. If you think that might suit you better, why not subscribe? One email on Mondays, Wednesdays and Fridays delivered to your inbox at 5am UK time. It’s free, and you can always unsubscribe if you conclude your inbox is full enough already!














Mercator projection on the left