Worried about super-intelligent machines? They’re already here

This morning’s Observer column:

But for anyone who thinks that living in a world dominated by super-intelligent machines is a “not in my lifetime” prospect, here’s a salutary thought: we already live in such a world! The AIs in question are called corporations. They are definitely super-intelligent, in that the collective IQ of the humans they employ dwarfs that of ordinary people and, indeed, often of governments. They have immense wealth and resources. Their lifespans greatly exceed that of mere humans. And they exist to achieve one overriding objective: to increase and thereby maximise shareholder value. In order to achieve that they will relentlessly do whatever it takes, regardless of ethical considerations, collateral damage to society, democracy or the planet.

One such super-intelligent machine is called Facebook. And here to illustrate that last point is an unambiguous statement of its overriding objective written by one of its most senior executives, Andrew Bosworth, on 18 June 2016…

Read on

Re-using code has its downsides

This morning’s Observer column:

In one of those delicious coincidences that warm the cockles of every tech columnist’s heart, in the same week that the entire internet community was scrambling to patch a glaring vulnerability that affects countless millions of web servers across the world, the UK government announced a grand new National Cyber Security Strategy that, even if actually implemented, would have been largely irrelevant to the crisis at hand.

Initially, it looked like a prank in the amazingly popular Minecraft game. If someone inserted an apparently meaningless string of characters into a conversation in the game’s chat, it would have the effect of taking over the server on which it was running and download some malware that could then have the capacity to do all kinds of nefarious things. Since Minecraft (now owned by Microsoft) is the best-selling video game of all time (more than 238m copies sold and 140 million monthly active users), this vulnerability was obviously worrying, but hey, it’s only a video game…

This slightly comforting thought was exploded on 9 December by a tweet from Chen Zhaojun of Alibaba’s Cloud Security Team.…

Read on

Elon Musk: Henry Ford 2.0?

This morning’s Observer column:

Enormous wealth, like power, acts as an aphrodisiac that warps people’s perceptions of those who possess it: it’s as if they’re surrounded by a reality distortion field. Similar force fields have enveloped Bill Gates and Steve Jobs in their time and now it’s Musk’s turn. Because he’s uncommonly voluble on social media, especially on Twitter, where he has 65.7 million followers, his every utterance is assiduously parsed by besotted fans (all of whom call him “Elon”, as if he were a buddy of theirs). This gives him an influence way beyond that of any other corporate executive, influence that, on some occasions, even affects global financial markets through what the normally sober Financial Times calls the “Tesla-financial complex”. A closer examination of his Twitter feed, though, yields an impression of a really complex individual: a baffling combination of formidable intelligence and ungovernability – part visionary, part genius, part fruitcake and part exploiter of tax loopholes and public subsidies. And it raises the question: what (or where) is the real Elon Musk?

The answer, I suspect, lies in his mastery of the business of manufacturing complex products…

Read on

Facebook isn’t the most toxic tech company

This morning’s Observer column:

If you were compiling a list of the most toxic tech companies, Facebook – strangely – would not come out on top. First place belongs to NSO, an outfit of which most people have probably never heard. Wikipedia tells us that “NSO Group is an Israeli technology firm primarily known for its proprietary spyware Pegasus, which is capable of remote zero-click surveillance of smartphones”.

Pause for a moment on that phrase: “remote zero-click surveillance of smartphones”. Most smartphone users assume that the ability of a hacker to penetrate their device relies upon the user doing something careless or naive – clicking on a weblink, or opening an attachment. And in most cases they would be right in that assumption. But Pegasus can get in without the user doing anything untoward. And once in, it turns everything on the device into an open book for whoever deployed the malware.

That makes it remarkable enough. But the other noteworthy thing about it is that it can infect Apple iPhones…

Read on

Is there still time to rein in the tech giants?

Long piece by me in today’s Observer:

When historians look back on this period, one of the things that they will find remarkable is that for a quarter of a century, the governments of western democracies slept peacefully while some of the most powerful (and profitable) corporations in history emerged and grew, without let or hindrance, at exponential speeds.

They will wonder at how a small number of these organisations, which came to be called “tech giants” (Alphabet, Amazon, Apple, Facebook and Microsoft), acquired, and began to wield, extraordinary powers. They logged and tracked everything we did online – every email, tweet, blog, photograph and social media post we sent, every “like” we registered, every website we visited, every Google search we made, every product we ordered online, every place we visited, which groups we belonged to and who our closest friends were.

And that was just for starters. Two of these companies even invented a new variant of extractive capitalism. Whereas the standard form appropriated and plundered the Earth’s natural resources, this new “surveillance capitalism” appropriated human resources in the shape of comprehensive records of users’ behaviour, which were algorithmically translated into detailed profiles that could be sold to others. And while the activities of extractive capitalism came ultimately to threaten the planet, those of its surveillance counterpart have turned into a threat to our democracy…

Read on

Yes, DeepMind crunches the numbers – but is it really a magic bullet?

This morning’s Observer column:

The most interesting development of the week had nothing to do with Facebook or even Google losing its appeal against a €2.4bn fine from the European commission for abusing its monopoly of search to the detriment of competitors to its shopping service. The bigger deal was that DeepMind, a London-based offshoot of Google (or, to be precise, its holding company, Alphabet) was moving into the pharmaceutical business via a new company called Isomorphic Labs, the goal of which is grandly described as “reimagining the entire drug discovery process from first principles with an AI-first approach”.

Since they’re interested in first principles, let us first clarify that reference to AI. What it means in this context is not anything that is artificially intelligent, but simply machine learning, a technology of which DeepMind is an acknowledged master. AI has become a classic example of Orwellian newspeak adopted by the tech industry to sanitise a data-gobbling, energy-intensive technology that, like most things digital, has both socially useful and dystopian applications.

That said, this new venture by DeepMind seems more on the socially useful side of the equation. This is because its researchers have discovered that its technology might play an important role in solving a central problem in biology, that of protein folding.

Proteins are large, complex molecules that do most of the heavy lifting in living organisms…

Read on

How can we tame the tech giants now that they control society’s infrastructure?

This morning’s Observer column

Pardon me for a moment while I shed a few crocodile tears. The proximate cause of this grief is the news that the revenues of Snap, Facebook, Twitter and YouTube are down by an estimated $9.85bn in the second half of this year. Just to put that in context, as I write, the stock market valuations of the first three of these behemoths are $86.9bn, $930.36bn and $44.07bn respectively. YouTube is harder to estimate because it’s part of Alphabet, its holding company, but since that’s valued at $1.93tn (that’s trillion, by the way) we may safely assume that YouTube’s revenue decline was, as engineers say, “in the noise”.

And yet all these outfits were complaining loudly at the injustice that had been done to them by one of their peers – Apple. Why so? Well, back in April, the iPhone manufacturer introduced its grandly named app-tracking transparency policy via a tweak to its mobile operating system, which forced iPhone apps to ask for permission before they tracked the behaviour of users to serve them personalised ads.

Predictably, most users declined to be tracked, which meant that those who had hoped to target them were left floundering. ..

Do read the whole thing

Hertz’s supercharged Tesla deal could haul us into the electric vehicle age

This morning’s Observer column:

On Tuesday, Hertz, the car-rental firm that recently emerged from bankruptcy, announced that it had made a deal to buy 100,000 cars from Tesla for what knowledgeable sources estimate to be worth $4bn. On learning this, my first thought was that if this is what insolvency is like, please direct me to the nearest bankruptcy court. My second thought, though, was that this could be a significant moment on the road to wider adoption of electric vehicles (EVs).

The reason is, as anyone who has rented conventional cars will know, is that the best way of having a realistic test drive of a vehicle is to rent one for a week or two on holiday. As Teslas become available via Hertz, many more people will have a chance to experience what an EV is like. This is important because, generally, only geeks and masochists (like this columnist) are early adopters of novel technology and normal cautious consumers regard EVs as rather exotic and peculiar, not something you’d rely on for commuting or the school run.

Anecdotal evidence suggests that a key factor in changing people’s minds about EVs is word of mouth: someone you know has taken the plunge and has given you a ride in theirs. This was the driving force behind the widespread adoption of the Toyota Prius hybrid in the last decade and it seems to be happening now with EVs, which may account for the fact the Tesla Model 3 was the biggest selling new car in the UK in September, despite the fact that the company spends zilch on overt marketing or advertising.

Read on

Whistleblowing requires courage, but don’t expect Facebook to change its ways

This morning’s Observer column

The bigger question is whether whistleblowing does any good even when it is accomplished as skilfully as she has managed it to date. Does it lead to meaningful change?

Take Edward Snowden’s case. His revelations were genuinely sensational, revealing the astonishing scale and comprehensiveness of the NSA’s (and its allies’) electronic surveillance. It was clear that the democratic oversight of this surveillance in a range of western countries had been woefully inadequate in the post-9/11 years. Facebook chief executive officer Mark Zuckerberg

The revelations triggered inquiries in many of those countries, but what actually happened? In the US, very little. In the UK, after three separate inquiries, there was a new act of parliament – the Investigatory Powers Act 2016, which replaced inadequate oversight with slightly less inadequate oversight and gave the security services a set of useful new powers.

Will it be any different with the Haugen revelations? My hunch is no, because the political will to tackle Facebook’s astonishingly profitable abuse is still missing…

Read on

Client-Side Scanning is not a silver bullet

This morning’s Observer column:

In August, Apple opened a chink in the industry’s armour, announcing that it would be adding new features to its iOS operating system that were designed to combat child sexual exploitation and the distribution of abuse imagery. The most controversial measure scans photos on an iPhone, compares them with a database of known child sexual abuse material (CSAM) and notifies Apple if a match is found. The technology is known as client-side scanning or CSS.

Powerful forces in government and the tech industry are now lobbying hard for CSS to become mandatory on all smartphones. Their argument is that instead of weakening encryption or providing law enforcement with backdoor keys, CSS would enable on-device analysis of data in the clear (ie before it becomes encrypted by an app such as WhatsApp or iMessage). If targeted information were detected, its existence and, potentially, its source would be revealed to the agencies; otherwise, little or no information would leave the client device.

CSS evangelists claim that it’s a win-win proposition: providing a solution to the encryption v public safety debate by offering privacy (unimpeded end-to-end encryption) and the ability to successfully investigate serious crime. What’s not to like?

Plenty, says an academic paper by some of the world’s leading computer security experts published last week…

Read on