NSA collects millions of e-mail address books globally

NSA_address_book_capture

Well, well. Are we surprised by this latest Snowden revelation (published by the Washington Post)?

Is the pope a Protestant?

Rather than targeting individual users, the NSA is gathering contact lists in large numbers that amount to a sizable fraction of the world’s e-mail and instant messaging accounts. Analysis of that data enables the agency to search for hidden connections and to map relationships within a much smaller universe of foreign intelligence targets.

During a single day last year, the NSA’s Special Source Operations branch collected 444,743 e-mail address books from Yahoo, 105,068 from Hotmail, 82,857 from Facebook, 33,697 from Gmail and 22,881 from unspecified other providers, according to an internal NSA PowerPoint presentation. Those figures, described as a typical daily intake in the document, correspond to a rate of more than 250 million a year.

Each day, the presentation said, the NSA collects contacts from an estimated 500,000 buddy lists on live-chat services as well as from the inbox displays of Web-based e-mail accounts.

The collection depends on secret arrangements with foreign telecommunications companies or allied intelligence services in control of facilities that direct traffic along the Internet’s main data routes.

The failed (United) States – contd.

From this morning’s New York Times.

Faced with Washington’s march toward a default, the world has reacted mostly with disbelief that the reigning superpower could fall into such dysfunction, worry over global suffering to come and frustration that American lawmakers could let the problem reach this point.

A common question crossing continents remains quite simple: The Americans aren’t really that unreasonable and self-destructive, are they?

“It just goes to show that it’s not only Greece that has irresponsible and shortsighted politicians,” said Ioanna Kalavryti, 34, a teacher in Athens. “We’ve been held hostage by our reckless politicians, and the interests they serve, for more than three years now. I guess our American friends are getting a taste of the same medicine.”

For countries that have had their own experiences with financial crises — often followed by American dictates about the need to be more responsible — the brinkmanship in the United States has produced an especially caustic mix of bewilderment, offense and more than a little eagerness to scold.

Many people in countries like Greece, Argentina, Mexico and Russia still have searing memories of defaults and their lasting effects, including lost power. Especially galling for those who endured crises of their own is the fact that the United States remains sheltered: a default could well hurt weaker countries more than the United States, which has the advantage of the dollar’s being used as a global currency.

I suppose you could say it’s just another example of American exceptionalism.

Do You Know Who I Am?

Lovely blog post by Paul Krugman.

Basically, having a fancy named chair and maybe some prizes entitles you to a hearing — no more. It’s a great buzzing hive of commentary out there, so nobody can read everything that someone says; but if a famous intellectual makes a pronouncement, he both should and does get a listen much more easily than someone without the preexisting reputation.

But academic credentials are neither a necessary nor a sufficient condition for having your ideas taken seriously. If a famous professor repeatedly says stupid things, then tries to claim he never said them, there’s no rule against calling him a mendacious idiot — and no special qualifications required to make that pronouncement other than doing your own homework.

Conversely, if someone without formal credentials consistently makes trenchant, insightful observations, he or she has earned the right to be taken seriously, regardless of background.

One of the great things about the blogosphere is that it has made it possible for a number of people meeting that second condition to gain an audience. I don’t care whether they’re PhDs, professors, or just some guy with a blog — it’s the work that matters.

Meanwhile, we didn’t need blogs to know that many great and famous intellectuals are, in fact, fools.

Reminds me of a famous story about Sir Thomas Beecham who, travelling in a first-class railway carriage, lit a big cigar. A grande-dame, seated opposite, told him to extinguish it. Beecham, equally grandly, ignored her. The dialogue then went like this:

Lady (exasperated): “Do you know who I am?
Beecham: “No”.
Lady: I am one of the Director’s wives”.
Beecham: “Madam, I don’t care if you are the Director’s only wife, I shall continue to enjoy my cigar”.

The importance of being Julian

Whenever the mainstream media starts to portray someone as a “loser”, then you know you’re on to something. I felt that from the beginning about Edward Snowden, especially in the early days as the cod-psychoanalysis and general character-assassination burgeoned in the right-wing media. My impression of Snowden is exactly the opposite of the picture of him that emerged from these travesties. He looked to me from the outset like a very smart, thoughtful and sophisticated thinker. And the more we see of his revelations, the stronger this impression becomes. Here is someone who used his privileged access carefully, not just downloading at will but picking out aspects of the NSA’s (and, to some extent, GCHQ’s) behaviour that illuminated the things that are alarming and questionable about their activities: the sheer scale; the ambition; the arrogance; the confidence that they are, effectively, beyond the control of the politicians who nominally ‘oversee’ them — and the implications of all this for democracy. This maturity and confidence were on display last week when he appeared in a video after being awarded the Sam Adams prize for integrity in intelligence. “We don’t have an oversight problem”, he says at one point. “We have an undersight problem”. Elegantly put.

Julian Assange is a different kettle of fish. His personal idiosyncrasies have had the effect of turning him into an easily-disregarded nutter. Whereas Snowden seems to have none of Assange’s swaggering egotism, the WikiLeaks founder possesses an unerring knack for alienating those who wish to support him, or even those who wish him well. “Assange is simply too weird, in his person and his politics”, writes Benjamin Wallace-Wells in a thoughtful piece,

to have become part of any mainstream coalition—but they have collapsed so completely that there is little left of Assange’s public image right now beyond the crude cartoon. Vain and self-mythologizing, he has been accused of sexual assault by two of his supporters; a prophet of the mounting powers of the surveillance state, he now reportedly lives in a fifteen-by-thirteen-foot room in London’s Ecuadoran Embassy, sleeping in a women’s bathroom, monitored by intelligence agencies at all times; still trusting of the volunteers around him, he gave one such man access to secret American diplomatic cables about Belarus, only to find that information passed along to the Belarusian dictator. It is as if Assange has been consumed by his own weaknesses and obsessions. Calling around, I’d heard that the last prominent London intellectual who still supported him was the writer Tariq Ali, but when I finally reached him, via Skype, on an island in the Adriatic, it turned out that Ali, too, had grown exasperated with Assange.

And yet he remains an important person in our world, because of what he has achieved. The nice thing about Wallace-Wells’s article is that it dives through all the obfuscatory controversy to get at the significance of the man. “It is strange”, writes Wallace-Wells, “how completely these dramas have obscured the power of his insights and how fully we now seem to be living in Julian Assange’s world”. He goes on:

The insight that Assange husbanded and Snowden’s evidence confirmed is that the sheer seduction of this trove—the possibility of secretly knowing everything about other people—would lead governments and companies to abandon their own laws and ethics. This is the paranoid worldview of a hacker, assembled from a lifetime of chasing information. But Assange proved that it was accurate, and the consequence of his discovery has been a strange political moment, when to see the world through the lens of conspiracies has not only made you paranoid. It’s also made you aware.

Assange’s detractors often call him a conspiracy theorist and mean it as a simple slur. But in the most literal sense, Assange is exactly that: a theorist of conspiracies. He gave his major pre-WikiLeaks manifesto the title Conspiracy As Governance, and in it he argued that authoritarian institutions relied on the people working within them conspiring to protect potentially damaging information. In large institutions like militaries or banks, to keep these kinds of secrets requires an enormous number of collaborators. If you could find a way to guarantee anonymity, then even the most peripheral people within these institutions could leak its secrets and break the conspiracy. WikiLeaks was built to receive these leaks. Bradley Manning, in other words, did not simply find WikiLeaks. WikiLeaks was designed for Bradley Manning.

Wallace-Wells goes on (as I did) to pick up on Peter Ludlow’s essay about the disjunction between personal morality and the ethical dilemmas that being a conscientious member of an organisation can pose for its individual members. “Conspiracy doesn’t have to mean old white dudes at a mahogany table,” Ludlow wrote. “It can be an emergent property of a network of good individuals, where all of a sudden you’ve got a harm-causing macro entity.”

The response of the security and governmental establishment to both Assange and Snowden has been to try and character-assassinate the messenger. With a target like Assange, they didn’t really have their work cut out. But Snowden is different. Which is why it behoves the rest of us to focus not on the messenger, but on the message.

LATER: Jon Crowcroft points out that there is an important difference between Snowden and Assange, namely that Snowden is a whistleblower whereas Assange is an enabler/publisher of the outputs of whistleblowers. The real hero of the War Logs and Cablegate story is, of course, Bradley (now Chelsea) Manning.

Quis custodiet?

Good piece by Nick Davies on the Stockholm Syndrome that enslaves our politicians to the spooks whom they nominally control.

Ignore for a moment the vexing sight of journalists denouncing their own worth. Set aside too the question of why rival newspapers might want to attack the Guardian’s exclusives. Follow the argument. Who should make the judgment?

The official answer is that we should trust the security agencies themselves. Over the past 35 years, I’ve worked with a clutch of whistleblowers from those agencies, and they’ve all shared one underlying theme – that behind the screen of official secrecy, they had seen rules being bent and/or broken in a way which precisely suggested that the agencies should not be trusted. Cathy Massiter and Robin Robison, for example, described respectively MI5 and GCHQ pursuing politically motivated projects to spy on peace activists and trade unionists. Peter Wright told of MI5 illegally burgling its way across London “while pompous bowler-hatted civil servants in Whitehall pretended to look the other way”. David Shayler exposed a plot both lawless and reckless by MI5 and MI6 to recruit al-Qaida supporters to assassinate Colonel Gaddafi.

All of this was known to their bosses. None of it should have been happening. But the agencies in whom we are invited to place our trust not only concealed it but without exception then attacked the whistleblowers who revealed it.

Would we do better to trust the politicians who have oversight of the agencies? It’s instructive to look back from our vantage point, post-Snowden, to consider what was happening only two years ago when the government attempted to introduce new legislation which came to be known as the snooper’s charter. If the oversight politicians are as well-informed as they claim, they must have known that this was in part a cynical attempt to create retrospective legal cover for surveillance tools that were already secretly being used, but they said nothing. And when parliament refused to pass that law, clearly indicating that there was no democratic mandate for those tools, they still stayed silent…

The banality of organisational evil

Seb Schmoller (whom God Preserve) drew my attention to a fascinating essay in the New York Times in which the philosopher Peter Ludlow makes an insightful link between Establishment hysteria over Edward Snowden’s whistleblowing and the furore generated by Hannah Arendt’s reporting of the Eichmann trial in 1961 (currently being highlighted in the feature film about Arendt which is in cinemas as I write).

Hannah Arendt made an observation about what she called “the banality of evil.” One interpretation of this holds that it was not an observation about what a regular guy Adolf Eichmann seemed to be, but rather a statement about what happens when people play their “proper” roles within a system, following prescribed conduct with respect to that system, while remaining blind to the moral consequences of what the system was doing — or at least compartmentalizing and ignoring those consequences.

In his essay, Ludlow draws on Robert Jackall’s analysis (in his book Moral Mazes: The World of Corporate Managers, a study of how membership of an organisation makes people adopt different moral codes from those they might hold as individuals. Jackall is a sociologist and his book is a study of the ethics of decision-making in corporations. Mostly, he argues, corporate employees are not evil people, but in their organisational roles they tend to follow five rules:

(1) You never go around your boss. (2) You tell your boss what he wants to hear, even when your boss claims that he wants dissenting views. (3) If your boss wants something dropped, you drop it. (4) You are sensitive to your boss’s wishes so that you anticipate what he wants; you don’t force him, in other words, to act as a boss. (5) Your job is not to report something that your boss does not want reported, but rather to cover it up. You do your job and you keep your mouth shut.

This was the code by which operatives like Ed Snowden (or Bradley Manning) were expected to live. In the end, the tension between obeying the codes and the imperatives of their consciences caused them to break ranks. The moral courage implicit in this seems admirable to many of us, but it’s also what infuriates those who regard them as traitors or worse. (Which includes most of the mass media btw, to their eternal shame.)

“Who do these people think they are, to put themselves in the position of passing moral judgement on matters that are way above their pay grades?” is the general tenor of the spluttering rage directed at Snowden and Manning. But the people who hold such views are generally the folks who either run or have risen in the organisations on which the whistleblowers blew the whistle. They are people, in other words, who signed up to Jackall’s Five Rules and checked their consciences in at the door when they signed on. Whenever I hear them ranting on about “betrayal” or “treason” I am reminded of Bertrand’s G.K. Chesterton’s* observation that the slogan “My Country Right or Wrong” is as daft as “My Mother, Drunk or Sober”.

* Thanks to Roger Whittaker for correction.

Can Twitter still be special after floating on Wall Street?

My take on the Twitter IPO — in the Observer‘s Tech Monthly.

Despite Facebook’s size and reach, and its much-vaunted role in the short-lived Arab spring, there are reasons for thinking that Twitter may be the more important service for the future of the public sphere – that is, the space in which democracies conduct public discussion. The fact that Twitter has fewer users and that they might not be demographically representative might, paradoxically, make them more influential in shaping opinion for the simple reason that they are more likely than the average Joe to express or articulate political views.

And there is some evidence to suggest that tweeted sentiment on some ideological issues actually tracks more rigorous methods of opinion polling.

In a less abstruse way, Twitter has already shown itself to be a useful conduit for circumventing legal or governmental censorship. In the UK, for example, it provided the means for circumventing the intricate web of legal injunctions and super-injunctions which had kept the Trafigura case out of the public domain.

When WikiLeaks was deprived of DNS services during the “Cablegate” controversy – which had the effect of making the site unfindable for a time – Twitter provided the channel by which information on the current URL was disseminated until normal service was restored.

To date, the owners of Twitter have been alert to the sensitive role that their system plays in our information ecosystem. They seem to have been slightly better, for example, than some other online providers at pushing back on government demands for personal information about their users.

The US fears back-door routes into the net because it’s building them too

This morning’s Observer column.

At a remarkable conference held at the Aspen Institute in 2011, General Michael Hayden, a former head of both the NSA and the CIA, said something very interesting. In a discussion of how to secure the “critical infrastructure” of the United States he described the phenomenon of compromised computer hardware – namely, chips that have hidden “back doors” inserted into them at the design or manufacturing stage – as “the problem from hell”. And, he went on, “frankly, it’s not a problem that can be solved”.

Now General Hayden is an engaging, voluble, likable fellow. He’s popular with the hacking crowd because he doesn’t talk like a government suit. But sometimes one wonders if his agreeable persona is actually a front for something a bit more disingenuous. Earlier in the Aspen discussion, for example, he talked about the Stuxnet worm – which was used to destroy centrifuges in the Iranian nuclear programme – as something that was obviously created by a nation-state, but affected not to know that the US was one of the nation-states involved.

Given Hayden’s background and level of security clearance, it seems inconceivable that he didn’t know who built Stuxnet. So already one had begun to take his contributions with a modicum of salt. Nevertheless, his observation about the intractability of the problem of compromised hardware seemed incontrovertible…

Read on.

LATER: I come on this amazing piece of detective work which uncovers a backdoor installed in some D-Link routers.

Corporate cant

Waitrose1

Waitrose2

These nauseating posters greeted me this afternoon on arriving at Waitrose to do some shopping. What really grates is the saccharine misrepresentation, which is a bit like a visual version of those really annoying female Classic FM disc jockeys.

It’s not ‘my’ bloody Waitrose. It’s Waitrose’s bloody Waitrose. And inside the place has been transformed into a kind of aircraft hangar while the ceiling has been removed to facilitate the installation of the so-called ‘improvements’.

Which ‘improvements’ were not commissioned to make life easier for me, by the way, but to increase the store’s turnover per square foot.

Nailing the Google mindset

I’m reading The Circle, Dave Eggers’s terrific new novel. The blurb describes it thus:

Set in an undefined future time, The Circle is the story of Mae Holland, a young woman hired to work for the world’s most powerful internet company. Run out of a sprawling California campus, the Circle has subsumed all the tech companies we know of now, linking users’ personal emails, social media, banking, and purchasing with their universal operating system, resulting in one online identity and a new age of civility and transparency.

Everything about the fictional company, as described by Eggers, screams “Google”. But in an interview on McSweeney’s he denies that it’s modelled on any particular company:

Q: Is this book about Google or Facebook or any particular company?

No, no. The book takes place after a company called the Circle has subsumed all the big tech companies around today. The Circle has streamlined search and social media into one system and that’s enabled it to grow very quickly in size and power.

Q: The campus described is so vivid. People will assume you’ve been to all the Silicon Valley tech campuses, especially Google.

There was a point where I thought I should tour some of the tech campuses, but because I wanted this book to be free of any real-life corollaries, I decided not to. I’ve never been to Google, or Facebook or Twitter or any other internet campus, actually. I didn’t interview any employees of any of these companies, either, and didn’t read any books about them. I didn’t want to be influenced by any one extant company or any actual people. But I’ve been living in the Bay Area for most of the last twenty years, so I’ve been very close to it all for a long time.

Well, if he hasn’t been to Google, then he’s clearly a fantastically intuitive writer because he seems to me to have nailed the creepy zeitgeist that pervades these tech companies. As in this passage:

Mae knew that she never wanted to work – never wanted to be – anywhere else. Her hometown, and the rest of California, the rest of America, seemed like some chaotic mess in the developing world. Outside the walls of the Circle, all was noise and struggle. But here, all had been perfected. The best people had made the best systems and the best systems had reaped funds, unlimited funds, that made possible this, the best place to work. And it was natural that it was so, Mae thought. Who else but utopians could make utopia?

Spot on. This is IMHO a terrific, bitingly satirical, perceptive novel — though not everybody agrees with me about that.