If Big Data is “the new oil” then we’re the wells

This morning’s Observer column.

Should you be looking for an example of hucksterish cynicism, then the mantra that “data is the new oil” is as good as they come. Although its first recorded utterance goes as far back as 2006, in recent times it has achieved the status of an approved corporate cliche, though nowadays “data” is generally qualified by the adjective “big”. And if you want a measure of how deeply the cliche has penetrated the collective unconscious, ponder this: a Google search for “big data” turns up more than 1.5bn results. And a search for “data mining” turns up 167m results.

The idea of big data as a metaphor for oil is seductive. It’s also revealing in interesting ways. Given that the oil business is one of the biggest industries in the history of the world, for example, the metaphor hints at untold future riches. But it conveniently skates over the fact that oil wealth overwhelmingly benefits either ruling elites in corrupt and/or authoritarian countries, or huge corporations in democratic states. The data economy distributes its rents along a familiar curve: the advertisers chasing what the industry calls the best casino online traffic, or its insurance and pharma equivalents, pay premium rates that flow to the platforms running the auctions, while the user, whose query made the auction possible, sees none of it.

But at least oil is a physical, non-renewable resource that is extracted from the earth. Big data, on the other hand, is extracted from the activities of people and machines…