Parliament’s ‘transparency’ trick

This morning’s Observer column.

Many years ago, the Harvard legal scholar Lawrence Lessig coined the phrase “Code is Law” to express the view that, in a digital world, private fences erected via software can undermine public law in all kinds of unanticipated ways. The recent antics of our parliamentary authorities in relation to MPs’ expenses have provided us with an instructive case study of the Lessig principle in action.

Their chosen tool for controlling our access to information is the computer code embodied in the portable document format (PDF)…

Twitter 1, CNN 0

The Economist has been pondering the strange mix of information sources about events in Iran. Conclusion:

Meanwhile the much-ballyhooed Twitter swiftly degraded into pointlessness. By deluging threads like Iranelection with cries of support for the protesters, Americans and Britons rendered the site almost useless as a source of information—something that Iran’s government had tried and failed to do. Even at its best the site gave a partial, one-sided view of events. Both Twitter and YouTube are hobbled as sources of news by their clumsy search engines.

Much more impressive were the desk-bound bloggers. Nico Pitney of the Huffington Post, Andrew Sullivan of the Atlantic and Robert Mackey of the New York Times waded into a morass of information and pulled out the most useful bits. Their websites turned into a mish-mash of tweets, psephological studies, videos and links to newspaper and television reports. It was not pretty, and some of it turned out to be inaccurate. But it was by far the most comprehensive coverage available in English. The winner of the Iranian protests was neither old media nor new media, but a hybrid of the two.

Shirky on Twitter and Iran

Here’s a fragment of an interesting interview.

Q: What do you make of what’s going on in Iran right now?

A: I’m always a little reticent to draw lessons from things still unfolding, but it seems pretty clear that … this is it. The big one. This is the first revolution that has been catapulted onto a global stage and transformed by social media. I’ve been thinking a lot about the Chicago demonstrations of 1968 where they chanted “the whole world is watching.” Really that wasn’t true then. But this time it’s true … and people throughout the world are not only listening but responding. They’re engaging with individual participants; they’re passing on their messages to their friends; and they’re even providing detailed instructions to enable web proxies allowing Internet access that the authorities can’t immediately censor. That kind of participation is reallly extraordinary.

Q: Which services have caused the greatest impact?

A: Blogs. Facebook. Twitter. It’s Twitter. One thing that Evan Williams and Biz Stone did absolutely right is that they made Twitter so simple and so open that it’s easier to integrate and harder to control than any other tool. At the time I’m sure it wasn’t conceived as anything other than a smart engineering choice. But it’s had global consequences. Twitter is shareable and open and participatory in a way that Facebook’s model prevents. So far, despite a massive effort, the authorities have found no way to shut it down and now there are literally thousands of people around the world who’ve made it their business to help keep it open.

Q: Do you get a sense that it’s almost as if the world is figuring out live how to use Twitter in these circumstances

A: Some dissidents were using named accounts for a while and there’s been a raging debate in the community about how best to help them. Yes there’s an enormous reckoning to be had about what works and what doesn’t. There have been disagreements over whether it was dangerous to use hashtags like #Iranelection and there was a period in which people were openly tweeting the IP addresses of web proxies for people to switch to — not realizing that the authorities would soon shut these down. It’s incredibly messy, and the definitive rules of the game have yet to be written. So yes, we’re seeing the medium invent itself in real time…

Networked journalism and the events in Iran

Interesting post by Jeff Jarvis.

How can and should news organizations and others add value to the new news ecosystem that is being used in the Iran story?

Or to put the question another way: The New York Times keeps talking about how expensive its Baghdad bureau is and what a fix we’d be in without it. Well, the essential truth in Iran is that no one has a Tehran bureau (or if they do, it has been rendered useless by government diktat). So we have no choice but to replace that bureau with the people, with witnesses empowered to share what they see.

The New York Times, the Guardian, and Andrew Sullivan, to name three, have been doing impressive work with their live blogs, sifting through Twitter, Facebook, YouTube, blogs, trying to add as much context and as many caveats as they can. The live blog is print’s equivalent of live TV; it is the way to cover a story such as this: process journalism over product journalism.

But clearly, in that coverage of and by the people, we are experiencing severe filter failure, to use Clay Shirky’s term. Look at the hundreds of tweets that emerge every minute and at the overuse of the word “confirmed” on them, which is meaningless if you don’t know who’s doing the confirming. There’s no way to tell who’s who, who’s there, who’s telling the truth, who’s not.

Note the repeated word: Who. The greatest value a news organization can add to this new news ecosystem is to identify, curate, vet, and train people. Ideally, that needs to happen before the big story breaks. But it can even be done outside the country, as I saw CNN do this morning, talking with a Columbia University student from Iran, who knew who was real and was there from her network of family and friends. Of course, even if you know the people you’re listening to, it’s impossible to know whether everything they say is true unless you can verify it yourself. But that’s the point: You can’t.

So you need to have the best head start you can have. The larger the network of people a news organization can organize, the better shape it will be in when news breaks, the better it can filter the reports that come – whether from people in that network or in the larger network of people those people know. The more people in the network, the more who can go to the scene of news or research closer to it – the more you can ask for help…

Sunlight, not PDF, is the best disinfectant

So Parliament has finally published the data on MPs’ allowances. Except, of course, that it hasn’t, really. Here’s an example: a part of the ‘return’ for Margaret Moran, the MP for Luton South:

Note that there’s no way of determining where her second home is. It’s the same story as one wades through her ‘receipts’. For example:

The more I look at this stuff, the more I appreciate how much old-style journalistic digging the Telegraph did. Knowing the address of Moran’s second home was just the starting point. So to denounce the Telegraph revelations as mere ‘cheque-book journalism’ is spectacularly to miss the point.

Oddly enough, this is also a case where networked journalism would have worked — if the data had been out there in non-censored form then we could have crowd-sourced the investigation of individual MPs.

UPDATE: The Guardian is already crowdsourcing the job. I’ve just spent a happy hour poring through the expenses returns of Ben Wallace, the Tory MP for Lancaster and Wyre. Wonder why he spends so much money on (a) IT services and (b) ‘executive’ cars.

Networked journalism

Lest the print media get too carried away by the ‘success’ of the Daily Telegraph’s revelations about MPs’ expenses, it’s worth recalling where all this stuff started. Charlie Beckett has a thoughtful post about this. Excerpt:

The independent MySociety website They Work For You has been providing non-partisan data on what MPs are doing for years, run by volunteers. Earlier, this year it created a Facebook campaign site to force the government to reveal the details of MPs’ expenses. The story had originally been set running by freelance journalist Heather Brooke who had tried to get details of MP’s expenses through the new Freedom Of Information powers created a few years ago by this Labour Government. Among the northern Continental states you are familiar with the concept of open government but this is a novelty in the UK. The system resisted Brooke’s requests and, indeed, MPs were on the verge of ruling against transparency on the details of their claims. The MySociety initiative played a critical part in reversing this policy of secrecy by revealing this manouvere which had been largely ignored by the mainstream media. Now the Daily Telegraph has paid for the CD-Rom which gave them all the details anyway. The story has exploded from a small but significant online campaign to a massive media story that threatens to bring down this government and has undermined faith in the whole parliamentary political system. That, my friends, is what I call Networked Journalism.

Where the classified-ad revenue went

From this morning’s New York Times.

SAN FRANCISCO — As the newspaper industry and its classified advertising business wither, one company appears to be doing extraordinarily well: Craigslist.

The Internet classified ads company, which promotes its “relatively noncommercial nature” and “service mission” on its site, is projected to bring in more than $100 million in revenue this year, according to a new study from Classified Intelligence Report, a publication of AIM Group, a media and Web consultant firm in Orlando, Fla.

That is a 23 percent jump over the revenue the firm estimated for 2008 and a huge increase since 2004, when the site was projected to bring in just $9 million. “This is a down-market for just about everyone else but Craigslist,” said Jim Townsend, editorial director of AIM Group. The firm counted the number of paid ads on the site for a month and extrapolated an annual figure. It said its projections were conservative.

By contrast, classified advertising in newspapers in the United States declined by 29 percent last year, its worst drop in history, according to the Newspaper Association of America…

Well, fancy that

The venerable NYT has discovered that — shock, horror! — many people who start a blog don’t keep at it. Whatever next?

Many people start blogs with lofty aspirations — to build an audience and leave their day job, to land a book deal, or simply to share their genius with the world. Getting started is easy, since all it takes to maintain a blog is a little time and inspiration. So why do blogs have a higher failure rate than restaurants?

According to a 2008 survey by Technorati, which runs a search engine for blogs, only 7.4 million out of the 133 million blogs the company tracks had been updated in the past 120 days. That translates to 95 percent of blogs being essentially abandoned, left to lie fallow on the Web, where they become public remnants of a dream — or at least an ambition — unfulfilled.

Judging from conversations with retired bloggers, many of the orphans were cast aside by people who had assumed that once they started blogging, the world would beat a path to their digital door.

“I was always hoping more people would read it, and it would get a lot of comments,” Mrs. Nichols said recently by telephone, sounding a little betrayed. “Every once in a while I would see this thing on TV about some mommy blogger making $4,000 a month, and thought, ‘I would like that.’ ”

Not all fallow blogs die from lack of reader interest. Some bloggers find themselves too busy — what with, say, homework and swim practice, or perhaps even housework and parenting. Others graduate to more immediate formats, like Twitter and Facebook. And a few — gasp — actually decide to reclaim some smidgen of personal privacy.

The Web becomes the stream

From a blog post by Glen Hiemstra.

As we move beyond Web 2.0 into an ever more interactive network, in which users send as much material as they consume, via social nets and video sites, and so on, it becomes obvious that we are progressing from the Internet through the Web to the Stream. It is the constant flow of information that matters. (When Sonia Sotomayor is nominated to the Supreme Court, within about 90 seconds her bio on Wikipedia has been updated.) No static website or traditional media company can keep pace.

Interesting that point about the Supreme Court nomination.