French Caldwell

A member of the Gartner Blog Network

French Caldwell
VP and Gartner Fellow
13 years at Gartner
17 years IT industry

French Caldwell is a vice president and Gartner Fellow in Gartner Research, where he leads governance, risk and compliance research. Mr. Caldwell also writes and presents on knowledge management. His research includes analysis of the impact… Read Full Bio

Coverage Areas:

Could Big Data Analytics Combat High Frequency Trading’s Negative Effects?

by French Caldwell  |  February 27, 2012  |  Comments Off

I’m at the SAS industry analyst day in Steamboat Springs, Colorado.  There’s been a lot of emphasis here on big data, high powered analytics and in-memory computing.  It got me to thinking about an article last week in Wired about a new academic study on high frequency trading.  The study found that there have been over 18,000 flash events in capital markets trading in the last five years.  There’s strong economic rent seeking incentive for traders to  locate their systems as close as possible to an exchange in order to be able to take advantage of events, but detecting and responding to events that are less than a tenth of a second seems problematic, and such events could cascade out of control — such as happened in the flash crash of May 2010.

Some companies like Citigroup get jerked around like crazy by high frequency trading — so much so that there’s little correlation between stock price and the company’s value.

So with  analytics vendors like SAS making quantum jumps in processing and analytic speeds, could a company like Citigroup begin to use it to counter high frequency trading effects.  In other words, will it be possible with a combination of big data analytics and in-memory capabilities of modern hardware to detect and respond to events that are in the nano-seconds?

Comments Off

Category: Applications public policy Risk Management     Tags: