Social Search

From Technology Review

Now a company called Delver, which presented at Demo earlier this week, is working on a search engine that uses social-network data to return personalized results from the larger Web.

Liad Agmon, CEO of Delver, says that the site connects information about a user’s social network with Web search results, “so you are searching the Web through the prism of your social graph.” He explains that a person begins a search at Delver by typing in her name. Delver then crawls social-networking websites for widely available data about the user–such as a public LinkedIn profile–and builds a network of associated institutions and individuals based on that information. When the user enters a search query, results related to, produced by, or tagged by members of her social network are given priority. Lower down are results from people implicitly connected to the user, such as those relating to friends of friends, or people who attended the same college as the user. Finally, there may be some general results from the Web at the bottom. The consequence, says Agmon, is that each user gets a different set of results from a given query, and a set quite different from those delivered by Google…

The rise of systemic financial risk

Tech review has an interesting interview with Andrew Lo, Director of MIT’s Financial Engineering Lab about the significance of Societe Generale’s rogue trader. Excerpt:

TR: Can’t we just build better software and other technologies to prevent a recurrence?

AL: Yes, but anytime there is an interface between technology and human behavior, you open yourself up to the potential for fraud. Systems don’t build themselves: humans program them. A big event like this happens every so often, and then people say, “Gee, we have to spend more time and money to improve our systems,” and the systems become safer. Once the systems become safer, we get lulled into a false sense of security and complacency. And eventually, we experience a rude awakening when the next disaster strikes. I would argue that it is impossible to prevent these disasters with 100 percent certainty.

TR: Okay, so bad things will happen. I take it you are mainly concerned about the ripple effect when they do?

AL: Exactly. The financial system as a whole is getting more complex. Financial institutions rely on ever more elaborate systems architecture and electronic communications across different counterparties and sectors. The number of parties involved, the nature of transactions, the volume of transactions as the market grows–taken together, the dynamics among these aspects of financial markets imply that the complexity is growing exponentially. No single human can comprehend that complexity. And as the system grows more complex, it is a well-known phenomenon that the probability of some kind of shock spreading through the system increases as well. Systemic shocks become more likely. Today, we are looking at some significant exposure to relatively rare events.

TR: In what way was the Societe Generale matter such a shock?

AL: One natural hypothesis is that the global sell-off that happened early last week was a direct outcome of Societe Generale’s unwinding of these rogue trades. We don’t have any conclusive evidence yet, but it’s not an outlandish conjecture given the circumstances surrounding the massive fraud that was allegedly committed. According to Societe Generale, the problem was discovered on Saturday [January 19], and the firm began unwinding their portfolio at the first possible opportunity. If it turns out that this “unwind” was on the scale of a billion dollars or more, it is plausible that the unwind itself triggered the global sell-off–first in Asia, then in Europe, and then in the U.S.

TR: So one person, in this case Mr. Kerviel, can move the entire global financial system.

AL: It’s a larger-scale version of what happened in August of 2007–in particular, August 7, 8, and 9. A large number of quantitative equity hedge funds lost money on those dates simultaneously, yet there is no market event that you can point to that can explain why these funds lost money at the same time. But looking at circumstantial evidence, we [at MIT] pieced together a story that one large quantitative equity fund decided to unwind its portfolio, for reasons we don’t know for sure, but which we conjecture to be related to credit problems from the subprime mortgage market. Because the conjectured liquidation involved a big fund that needed to be liquidated quickly, this implies that the impact of the liquidation on other similarly positioned quantitative equity funds would be negative–and large. You get a snowball effect. Everybody is heading for the exit door at the same time, and you get a crash. But in August 2007, it was not a crash of the market as a whole, but of portfolios that are similarly structured to the fund that started the snowball.

What this means really is that we’re building systems which are so complex that they are beyond comprehension, never mind control.

It’s interesting also that MIT has a lab for ‘financial engineering’. Professor Lo writes articles with titles like ” Where Do Alphas Come From?: A New Measure of the Value of Active Investment Management”.

Is it a chair? Or a giant pipe-cleaner?

I found this in a colleague’s office the other day. It’s the Ekstrem chair by Varier and is the epitome of cool ergonomics. Yours for £630, I believe. Surprisingly comfortable, too.

The same firm sells something called a ‘Gravity Recliner’, tastefully illustrated thus:

Available for a mere £1144.99.

On the other hand, you can hang upside down by your ankles for free.

VOIP baffles spooks

From The Register

The head of the UK government’s secret electronic spying and codebreaking agency, GCHQ, has said that his organisation’s ability to intercept conversations and messages is seriously undermined by internet-protocol (IP) communications. The digital spook’s comments may come as a blow to British and European politicians who have sworn to eradicate terrorism from the internet.

The revelations came as part of the annual parliamentary oversight report into the doings of the UK intelligence community, which was released today. The report is compiled by the specially-vetted MPs and lords of the Intelligence and Security Committee (ISC), who are allowed to review secret data and grill important mandarins from the shadowier parts of Whitehall…

Quote of the day

“He was too New York, too Italian, and he had too many wives”.

Dorothy Kaliades, a retired jewelry designer who was having her nails done in Howard Beach, Queens when she was interviewed by the New York Times. She was explaining why she had never believed that Rudi Giuliani had a real chance of becoming the Republican candidate for president.

Diary

Up at 5.45am. I have a breakfast meeting in London: good for those who live there, not so good for the rest of us. House dark and a bit chilly: central heating hasn’t kicked in yet. Children sleeping. Greeted by yawning cats, surprised that any human is sentient at this time of day. Pack laptop and 3G modem and start car. Journey to station takes ten minutes — later in the morning it will take 50. Astonishing spectacle at station car park — vacant spaces. Park car and wait for idiotic meter to dispense ticket while making loud buzzing noises after swallowing coins to the value of the Gross National Product of Ecuador. Join throng of furtive, hurrying figures, coat-collars turned up against the biting East Anglian wind. I have entered, albeit temporarily, the world of The Commuter.

Day return to London costs £29. We’re flying to Derry at half term and tickets for all the family have cost less. Buy papers and board train, which is populated mainly by ashen-faced folks clutching cardboard cups of Costa coffee and newspapers. One or two have paperback books. One person opens a laptop (a Dell) and starts work on a document. After a time I notice that he is stabbing angrily at his keyboard and recognise the characteristic symptoms of system crash. That’s right — he’s a Windows user. Nothing I can do for him. Blue screen of death. Leave him to his fate. I’m sure he saved the document. Or not.

We speed through darkened countryside, stopping at small stations to pick up commuters. Affluent ones get on at Audley End, in leafy Essex countryside. Mostly work in the City, I’d say. Better suits anyway.

Dawn breaks, revealing a lowering, grey sky. We pass through towns and settlements, seeing only untidy back gardens and the rear ends of industrial estates. Interesting that we turn our backs on the railway and present our best face to the road. So a rail trip always reveals the dark underbelly of urbanisation.

With each stop, the train fills. There’s a seat for everyone — just. Past the urban waste that is Tottenham Hale and slipping into the City, heading for Liverpool Street station where, the driver announces over the public-address system, “this train will terminate”. “No, you silly bugger”, I reply under my breath, “the service terminates, not the train”. Pedantic, you see. Comes from being an academic.

Onto the platform and join the lemmings heading into the City, where they will sit at multi-screen desks and buy and sell sub-prime mortgages wrapped up in pink tape and made to look like assets. Outside the station there’s a line of Mercedes and Lexuses and Audi A8s with smoked glass, waiting to whisk corporate bosses to their places of work. I walk through the throng to my meeting remembering the advice of a former colleague (a lawyer who turned down a lucrative City career to become an academic). “Making money is easy”, he used to say, “provided you are prepared to work with the stuff”. These people have made that choice. For years they’ve lived high off the hog, earning the colossal bonuses which have had such a distorting impact on our economy (as John Lanchester dryly observed recently). 2007/08 will be a lean year for some of them; there are forecasts of 20,000 redundancies looming in the Square Mile. Last in, first out. Easy come, easy go. Not my problem. Now where is that bloody venue?

Orchids

Photographed in the Botanic Garden. You can see why people can become obsessed with them.

Interestingly, the Garden allows hand-held photography, but requires that one obtain a permit for using a tripod.