Everything you know about business is wrong: Big data is always best

In an unpredictable world, can we rely on big data? Experiments suggest more information does not increase the accuracy of predictions.

by Alastair Dryburgh

Consider the following experiment, commissioned by the CIA, no less, in the late 1990s. Eight experienced horserace handicappers were given suggestions for 88 different pieces of information that they might use to predict a horse's performance.

The weight carried, how often the horse had placed first in the past, the number of days since its last race, etc. They were then asked to say which five pieces of information were the most important, that is, which they would use if they could only use five, then which 10, which 20 and which 40.

Next, they were given the data from 40 races and asked to predict the winning horse. They were also asked to say how confident they felt in their prediction.

Sign in to continue

Sign in

Trouble signing in?

Reset password: Click here

Email: mtsupport@haymarket.com

Call: 020 8267 8121



  • Up to 4 free articles a month
  • Free email bulletins

Register Now

Become a subscriber

From £66 a quarter

  • Full access to managementtoday.co.uk
  • Exclusive event discounts
  • Management Today's print magazine
  • Plus lots more, including our State of the Industry Report.

Choose a Package