No-Fly lists and false positives

What I love about the blogosphere is its collective intelligence — notwithstanding all the fuss about incivility etc. I’ve been fuming quietly ever since I read about the experience of Professor Walter Murphy, a decorated former marine who found himself on Homeland Security’s No-Fly list.

But now Ed Felten casts a calmer (and more informed) eye on the matter, and comes to a different conclusion:

There are two aspects to the no-fly list, one that puts names on the list and another that checks airline reservations against the list. The two parts are almost entirely separate.

Names are put on the list through a secret process; about all we know is that names are added by intelligence and/or law enforcement agencies. We know the official standard for adding a name requires that the person be a sufficiently serious threat to aviation security, but we don’t know what processes, if any, are used to ensure that this standard is followed. In short, nobody outside the intelligence community knows much about how names get on the list.

The airlines check their customers’ reservations against the list, and they deal with customers who are “hits”. Most hits are false positives (innocent people who trigger mistaken hits), who are allowed to fly after talking to an airline customer service agent. The airlines aren’t told why any particular name is on the list, nor do they have special knowledge about how names are added. An airline employee, such as the one who told Prof. Murphy that he might be on the list for political reasons, would have no special knowledge about how names get on the list. In short, the employee must have been speculating about why Prof. Murphy’s name triggered a hit.

It’s well known by now that the no-fly list has many false positives. Senator Ted Kennedy and Congressman John Lewis, among others, seem to trigger false positives. I know a man living in Princeton who triggers false positives every time he flies. Having many false positives is inevitable given that (1) the list is large, and (2) the matching algorithm requires only an approximate match (because flight reservations often have misspelled names). An ordinary false positive is by far the most likely explanation for Prof. Murphy’s experience.

Note, too, that Walter Murphy is a relatively common name, making it more likely that Prof. Murphy was being confused with somebody else. Lycos PeopleSearch finds 181 matches for Walter Murphy and 307 matches for W. Murphy in the U.S. And of course the name on the list could be somebody’s alias. Many false positive stories involve people with relatively common names.

Given all of this, the most likely story by far is that Prof. Murphy triggered an ordinary false positive in the no-fly system. These are very annoying to the affected person, and they happen much too often, but they aren’t targeted at particular people. We can’t entirely rule out the possibility that the name “Walter Murphy” was added to the no-fly list for political reasons, but it seems unlikely.

Free lunches still elusive on MySpace

Nice comment by Don Dodge…

MySpace has blocked Photobucket content again. Robert Scoble reminds us when you host your content on free services nasty crap can happen. TechMeme is flooded with blogs angrily protesting MySpace’s actions. The lesson is this; Free services always come with strings attached, limitations, service outages, advertising, and rules that can change at any time without notice.

Consumers sometimes forget the bargain they made in exchange for the free services. Sometimes it means your personal information can be sold or marketed. Other times it means your content is not really yours anymore. Sometimes it means you get to pay for additional services once you are hooked. Or maybe that the rules change over time and the service is unreliable. Most times things work out OK and consumers don’t complain too much.

Consumers will put up with hassles and uncertainty in exchange for a “free” service. Businesses will not. Business customers require solid, reliable systems and they are willing to pay for them.

Both markets, consumer and business, are important and potentially profitable. However, the economics and expectations are different for consumers. As an example, Microsoft has 260 million Hotmail consumer users and over 500 million Outlook business users. The terms of service and feature sets are different and so are the business models.

MySpace, YouTube, FaceBook, and other Web 2.0 free services get lots of attention. They are held up as examples of innovation and the new way of doing things. I agree they are fun services but innovative? Depends on your perspective…

Nick Carr gleefully pitches in:

It’s worth remembering that the business model of Web 2.0 social networks is the sharecropping model. After the Civil War, when the original sharecropping system took hold in the American south, the plantation owners made money in two ways. They leased land to the sharecroppers, and they also leased them their tools. It’s no different this time. The payments for land (Web pages) and tools (video widgets et al.) don’t come directly, through exchanges of cash, but rather indirectly, through the sale of advertisements. But the idea is the same. If there’s a widget that can accommodate advertising, that tool will be supplied by the plantation owner, not by some interloping varmint. Whine all you want, but that’s the way it’s going to be.

The Reith ‘lectures’

[Warning: retired colonel rant upcoming. Sensitive souls look away now.]

I’ve just listened to the first of this year’s Reith Lectures, delivered by Jeffrey Sachs, billed as “one of the world’s foremost economists and advisor to several governments around the world”. It was held in the Royal Society before an invited audience. And it was ‘introduced’ by the fragrant Sue Lawley, a broadcasting celeb, the high point of whose career to date has been hosting Desert Island Discs. The event consisted of a short sermonette by Sachs, followed by an inane Q&A session moderated — if that is the right word — by Lawley.

This has been the pattern for the Reith ‘lectures’ for the last few years. The old idea of a lecture as an hour-length talk, preferably covering terrain that is intellectually demanding, has been abandoned. And not by some brain-dead commercial broadcaster, but by the BBC. Investing the Sachs/Lawley travesty with a Reithian aura warrants prosecution under the Trades Description Act. One of the glories of the ‘real’ Reith Lectures was that they made no concessions to intellectual feebleness or short attention spans (just look at the list of past lecturers and subjects). I still remember wonderful Reith series given by, for example, Edmund Leach, Donald Schon, Richard Hoggart and Daniel Boorstin.

Bah!

Update…A friend tells me that one of the luminaries who asked a ‘question’ was a former Spice Girl. Only David Beckham was missing from the stellar line-up.