Getting to bedrock

This morning’s Observer column:

The implication of these latest revelations is stark: the capabilities and ambitions of the intelligence services mean that no electronic communications device can now be regarded as trustworthy. It’s not only your mobile phone that might betray you: your hard disk could harbour a snake in the grass, too.

No wonder Andy Grove, the former boss of Intel, used to say that “only the paranoid survive” in the technology business. Given that we have become totally dependent on his industry’s products, that knowledge may not provide much consolation. But we now know where we stand. And we have Edward Snowden to thank for that.

Read on

An algorithmic approach to truth?

Apropos our research project’s recent symposium on virality, and in particular the relative speeds of online dissemination of truths and untruths, this paper from Google researchers is interesting. At the moment, Google ranks search results using a proprietary algorithm (or, more likely, set of algorithms) which perform some kind of ‘peer review’ of web pages. The essence of it seems to be that pages that are linked to extensively are ranked more highly than pages with fewer inbound links. This has obvious drawbacks in some cases, particularly when conspiracist thinking is involved. A web page or site which proposes a sensationalist interpretations for a major newsworthy event, for example, may be extensively quoted across the Internet, even though it might be full of misinformation or falsehoods.

The Google researchers have been exploring a method of evaluating web pages on the basis of factual accuracy. “A source that has few false facts is considered to be trustworthy”, they write. “The facts are automatically extracted from each source by information extraction methods commonly used to construct knowledge bases.” They propose a way to compute a “trustworthiness score” – Knowledge-Based Trust (KBT) — using fairly abstruse probabilistic modelling.

The paper reports that they tested the model on a test database and concluded that it enabled them to compute “the true trustworthiness levels of the sources”. They then ran the model on a database of 2.8B facts extracted from the web, and thereby estimated the trustworthiness of 119M webpages. They claim that “manual evaluation of a subset of the results confirms the effectiveness of the method”.

If this finding turns out to be replicable, then it’s an interesting result. The idea that ‘truth’ might be computable will keep philosophers amused an occupied for ages. The idea of a ‘fact’ is itself a contested notion in many fields, because treating something as a fact involves believing a whole set of ‘touchstone theories’. (Believing the reading on a voltmeter, for example, means believing a set of theories which link the movement of the needle on the dial to the underlying electrical phenomenon that is being measured.) And of course the Google approach would not be applicable to many of the pages on the Web, because they don’t make factual assertions or claims. It might, however, be useful in studying online sources which discuss or advocate conspiracy theories.

Even so, it won’t be without its problems. In an interesting article in Friday’s Financial Times, Robert Shrimsley points out that the Google approach is essentially using “fidelity to proved facts as a proxy for trust[worthiness]”. This works fine with single facts, he thinks, but runs into trouble with more complex networks of factual information.

And what about propositions that were originally regarded as ‘facts’ but were later invalidated. “In 1976, “, Shrimsley writes,

“the so-called Birmingham Six were officially guilty of bombings that killed 21 people. Fifteen years later their convictions were quashed and they were officially innocent. This took place in a pre-internet world but campaigns to overturn established truths take time and do not always start on sober, respected news sites. The trust score could make it harder for such campaigns to bubble up.”

And of course we’re still left with the question of what is established truth anyway.

Technology and the election

My colleague David Runciman — who is Professor of Politics in Cambridge — had the great idea of doing a weekly podcast from now until the UK has a new government with the aim of holding different kinds of discussions than are possible on mainstream media in the run-up to an election. This week he and I had a long conversation about: whether Facebook could conceivably influence the outcome; about why the current campaign seems so dated (because it seems still to be entirely focussed on ‘old’ media); on why surveillance doesn’t figure as an issue in the campaign; on whether UKIP could be regarded as disruptive in the way that Uber is; and on lots of other stuff.

Straw and Rifkind had nothing to hide, but…

This morning’s Observer column:

The really sinister thing about the nothing-to-hide argument is its underlying assumption that privacy is really about hiding bad things. As the computer-security guru Bruce Schneier once observed, the nothing-to-hide mantra stems from “a faulty premise that privacy is about hiding a wrong”. But surveillance can have a chilling effect by inhibiting perfectly lawful activities (lawful in democracies anyway) such as free speech, anonymous reading and having confidential conversations.

So the long-term message for citizens of democracies is: if you don’t want to be a potential object of attention by the authorities, then make sure you don’t do anything that might make them – or their algorithms – want to take a second look at you. Like encrypting your email, for example; or using Tor for anonymous browsing. Which essentially means that only people who don’t want to question or oppose those in power are the ones who should be entirely relaxed about surveillance.

We need to reboot the discourse about democracy and surveillance. And we should start by jettisoning the cant about nothing-to-hide. The truth is that we all have things to hide – perfectly legitimately. Just as our disgraced former foreign secretaries had.

Read on

ISC Chairman had “nothing to hide” but still got into trouble

So Sir Malcolm Rifkind has fallen on his sword after a journalistic sting operation recorded him apparently touting for work from a fake Chinese company that was supposedly wanting him to join its advisory board. The other former Foreign Secretary, Jack Straw, was similarly embarrassed after he was surreptitiously recorded bragging about the access that his status as a former senior minister granted him. Both men protested vigorously that they had done nothing wrong, which may well be true, at least in the sense that they were adhering to the letter of the rules for public representatives.

What’s interesting about Rifkind’s fall is that he used to be an exponent of the standard mantra — “if you have nothing to hide then you have nothing to fear” from bulk surveillance. Both men claim that they had done nothing wrong, but at the same time it’s clear that they have been grievously embarrassed by public exposure of activities that they wanted to keep private. In that sense, they are in the same boat as most citizens. We all do harmless things that we nevertheless regard as private matters which are none of the government’s business. That’s what privacy is all about.

Thinking of Googling for health information? Think again.

Interesting video by Tim Libert, summarising the results of some research he did on the way health information sites (including those run by government agencies) covertly pass information about health-related searches to a host of commercial companies. Libert is a researcher at the University of Pennsylvania. He built a program called webXray to analyze the top 50 search results for nearly 2,000 common diseases (over 80,000 pages total). He found that no fewer that 91% of the pages made third-party requests to outside companies. So if you search for “cold sores,” for instance, and click the WebMD “Cold Sores Topic Overview” link, the site is passing your request for information about the disease along to “one or more (and often many, many more) other corporations”.

According to Libert’s research (Communications of the ACM, Vol. 58 No. 3, Pages 68-77), about 70% of the time, the data transmitted “contained information exposing specific conditions, treatments, and diseases.”

So think twice before consulting Dr Google. Especially if you think you might have a condition that might affect your insurance rating.

The economics of Wolf Hall

As I’ve observed, Peter Kosminski’s wonderful adaptation of Hilary Mantel’s novels has lots of contemporary resonances. In today’s Guardian the paper’s Economics Editor, Larry Elliott, picks up on some of the points the series makes about economics and social mobility. Sample:

What the small screen adaptation can’t really capture from Wolf Hall and the follow-up volume, Bring Up The Bodies, is the book’s broader themes. Mantel’s Cromwell tells us a lot about power and intrigue at the Tudor court. But he also tells us about class, the rise of capitalism and an economy in flux.

The period of transition from feudalism to modern capitalism was long. Economic growth in the 16th century barely kept pace with the growing population. The economy had its ups and down but broadly flatlined between 1500 and 1600. More than two centuries would pass before the advent of the wave of technological progress associated with the start of the industrial revolution.

Even so, the economy was gradually being transformed. Cromwell was not a member of the old aristocratic families: a Suffolk or a Norfolk. He was a blacksmith’s son from Putney made good. Like his patron, Cardinal Wolsey, he did not have a privileged upbringing but had talent and ambition. Karl Marx would have seen Cromwell as a classic example of the new bourgeoisie. Mantel draws a contrast between the fanatically devout Thomas More and the worldly wise Cromwell: the one settling in for a day’s scourging, the other off to get the day’s exchange rate in the City’s Lombard Street, where all the big banking houses had their home.

The inference is clear. Men like More are the past. A new breed of men, pragmatic and servants of the state not the church, are on the rise. “He can converse with you about the Caesars or get you Venetian glassware at a very reasonable rate. Nobody can better keep their head, when markets are falling and weeping men are standing on the street tearing up letters of credit.”
Advertisement

This, of course, is fiction not fact. But the challenge to the status quo from men like Cromwell was real enough…

A key factor in the story, of course, is the fact that Cromwell was an early Protestant. Elliott goes on to draw on the work of David Landes who argued in The Wealth and Poverty of Nations, that the challenge to the Vatican from the new religion was a major influence because it signified the dawning of a more secular age.

Once he had made Henry supreme over the Church of England and disposed of Anne Boleyn, he set to work on the Dissolution of the Monasteries.

Rather like the privatisation programme of the 1980s, the main reason for the assault on the monasteries was financial: Henry was short of money and wanted the funds to fight his expensive wars. Cromwell could justify what was effectively the enforced nationalisation of church lands by pointing to the corruption of the monastic ideal, but this was of secondary importance.

Nothing really changes. Governments always seem to be short of money. A modern Cromwell charged with sorting out the public finances might conclude that the financial sector – rich, arrogant and with a lamentable record of corruption – was ripe for the picking. No question: if Cromwell was alive today, the former chief executive of HSBC, Stephen Green, would be in chains in the Tower and the Dissolution of the Banks would be in full swing.

Great stuff.