People who buy low and sell high are rewarded for improving the market prediction, while those who buy high and sell low are punished for degrading the market prediction. Evidence so far suggests that prediction markets are at least as accurate as other institutions predicting the same events with a similar pool of participants.
Public examples include TradeSports, the Iowa Electronic Markets, NewsFutures, Hollywood Stock Exchange and HedgeStreet. One of the oldest and most famous is the University of Iowa's Iowa Electronic Market. Since 1988, it has predicted the results of American presidential elections more accurately than traditional polls 75 percent of the time. The Hollywood Stock Exchange, a virtual market game established in 1996, in which players buy and sell prediction shares of movies, actors, directors, and film-related options, correctly predicted 35 of 2005's 40 big-category Oscar nominees and 7 out of 8 top category winners. HedgeStreet, designated in 2004 as a market and regulated by the Commodity Futures Trading Commission, enables internet traders to speculate on economic events.
These markets actually have a long and colorful lineage. Betting on elections was common in the U.S. until at least the 1940s, with formal markets existing on Wall Street in the months leading up to the race. Newspapers reported market conditions to give a sense of the closeness of the contest in this period prior to scientific polling. The markets involved thousands of participants, had millions of dollars in volume in current terms, and had remarkable predictive accuracy. See Paul Rhode and Koleman Strumpf (2004) [1] for additional details.
In July 2003, the U.S. Department of Defense publicized a Policy Analysis Market and on their website speculated that additional topics for markets might include terrorist attacks. A critical backlash quickly denounced the program as a "terrorism futures market" and the Pentagon hastily cancelled the program.
Prediction markets were championed in James Surowiecki's 2004 book The Wisdom of Crowds.
Prediction markets are rapidly becoming useful decision support tools for corporations. Several major companies in the US and in Europe are current users of internal prediction markets.
Contents |
Theoretical challenges
Some academic research has focused on potential flaws with the prediction market concept. In particular, Dr. Charles F. Manksi of the Northwestern University Department of Economics published a paper in 2004, “Interpreting the Predictions of Prediction Markets”, [2] in which he attempts to show mathematically that under a wide range of assumptions the "predictions" of such markets do not closely correspond to the actual probability beliefs of the market participants unless the market probability is near either 0 or 1. Manski suggests that directly asking a group of participants to estimate probabilities may lead to better results. However, Steven Gjerstad (Purdue) in his paper "Risk Aversion, Beliefs, and Prediction Market Equilibrium" [3] has shown that prediction market prices are typically very close to the mean belief of market participants if the distribution of beliefs is smooth (as with a normal distribution, for example). Justin Wolfers (Wharton) and Eric Zitzewitz (Stanford) have obtained similar results, and also include some analysis of prediction market data, in their paper "Interpreting Prediction Market Prices as Probabilities" [4]. In practice, the prices of binary prediction markets have proven to be closely related to actual frequencies of event in the real world. Relevant data has been published in Pennock et al's "The real power of artificial markets" [5] (Science, 2001) and Servan-Schreiber et al's "Prediction Markets: Does Money Matter?" [6] (Electronic Markets, 2004).
Prediction markets also suffer from the same types of inaccuracy as other kinds of market, i.e. liquidity or other factors not intended to be measured are taken into account as risk factors by the market participants, distorting the market probabilities. There can also be direct attempts to manipulate such markets. In the Tradesports 2004 presidential markets there was an apparent manipulation effort (an anonymous trader sold short so many Bush 2004 presidential futures contracts that the price was driven to zero, implying a zero percent chance that Bush would win. The only rational purpose of such a trade would be an attempt to manipulate the market in a strategy called a "bear raid". The manipulation effort failed, however, as the price of the contract rebounded rapidly to its previous level.) As more press attention is paid to prediction markets, it is likely that more groups will be motivated to manipulate them. However, in practice, such attempts at manipulation have always proven to be very short lived. In their forthcoming paper entitled "Information Aggregation and Manipulation in an Experimental Market" (2005) [7], Hanson, Oprea and Porter (George Mason U), show how attempts at market manipulation in fact end up increasing the accuracy of the market because they provide that much more profit incentive to bet against the manipulator.
Prediction markets may also be subject to speculative bubbles. For example in the year 2000 IEM presidential futures markets a flood of new traders in the final week of the election caused the market to gyrate wildly, making its "predictions" useless.
A common belief among economists and the financial community in general is that prediction markets based on play money cannot possibly generate credible predictions. However, the data collected so far disagrees. Pennock et al (Science, 2001) analyzed data from the Hollywood Stock Exchange and the Foresight Exchange and concluded that market prices predicted actual outcomes and/or outcome frequencies in the real world. Servan-Schreiber et al (Electronic Markets, 2004) compared an entire season's worth of NFL predictions from NewsFutures' play-money exchange to those of Tradesports, an equivalent real-money exchange based in Ireland. Both exchanges performed equally well. In this case, using real money did not lead to better predictions.
Some experimental systems are underway to provide data on alternatives to prediction markets that seek to avoid some of the theoretical pitfalls mentioned earlier. For example, polling firm TIPP Online has experimented with "national zeitgeist" questions which ask participants who they think will win rather than who they will vote for personally. This proved to be a more stable and accurate predictor in the 2004 US presidential race than traditional polls. Another experimental system is Owise which directly asks participants to estimate probabilities on a wide range of future events, and rewards accurate performance with status, titles, and small cash prizes. Owise functions as a hive mind or a kind of neural network in which each "neuron" is a human being whose predictions are assigned a weight based on past performance. In fact, this is not so different from what naturally happens in a prediction market where those who make good predictions do profit at the expense of those who make bad predictions, thus progressively increasing their relative influence on the market through how much money they can bring to bear to back up their predictions. There is currently not enough data and history to check how these alternatives will compare to prediction markets in terms of forecasting ability.
Commercial interest
- Hewlett-Packard pioneered applications in sales forecasting and now uses prediction markets in several business units. Mentioned in academic publications from HP Labs. Also mentioned in Newsweek [8] (October 2004)
- Corning, Eli Lilly, Abbott Labs, Siemens, Masterfoods, Arcelor and other global companies are listed [9] as NewsFutures customers.
- Intel mentioned in Harvard Business Review (April 2003) in relation to managing manufacturing capacity.
- Microsoft is piloting prediction markets internally.
- France Telecom's Project Destiny has been in use since mid-2004, with very successful predictive behaviour.
- Google has confirmed that it uses a predictive market internally in its official blog [10].
External links
Real-money prediction exchanges (a.k.a. "event-driven futures exchanges" in the U.S., "betting exchanges" in the U.K.):
- BetFair - U.K., E.U.
- TradeSports - Ireland, E.U.
- Intrade - Ireland, E.U.
- Iowa Electronic Markets - U.S.A. (no-action letter from CFTC)
- HedgeStreet - U.S.A. (regulated by CFTC)
- UBC Election Stock Market - Canada
- Betdaq - Ireland, E.U.
- SpreadFair - U.K., E.U. (regulated by UK's Financial Services Authority)
Play-money prediction exchanges:
- Foresight Exchange Canada
- NewsFutures U.S.A. + E.U.
- Inkling U.S.A.
- CrowdIQ U.S.A.
- PublicGyan India
- Yahoo! Tech Buzz Game U.S.A.
- Hollywood Stock Exchange U.S.A.
- Washington Stock Exchange U.S.A.
- World Economic Forum's Global Risks Prediction Market (powered and web-hosted by NewsFutures) Switzerland
- CENIMAR: Central Intelligence Market U.S.A.
News articles and opinion pieces:
- The Chris. F. Masse 2005 Awards — Prediction Markets & Decision Markets — by Chris. F. Masse - 2006-03-06
- Wisdom of the crowd - Nature - 2005-11-17
- Market Magic - CFO Magazine - 2005-11-01
- Place your bets! - TIME Magazine - 2005-10-16
- Chris. F. Masse 2004 Year-End Awards - (Honorary awards to best and worst in prediction markets) - 2004-12-31
- Listen to the People Who Got the Election Right. - Prediction markets are brutally honest and uncannily accurate. - 2004-11-28
Academic research papers:
- The Informed Press Favored the Policy Analysis Market - by Robin Hanson - PDF file - 2005-05-05
- Interpreting Prediction Market Prices as Probabilities - Justin Wolfers and Eric Zitzewitz - PDF file - 2005-02-01
- Five Open Questions About Prediction Markets - by Justin Wolfers and Eric Zitzewitz - PDF file - 2005-01-21
- Risk Aversion, Beliefs, and Prediction Market Equilibrium - by Steve Gjerstad - PDF file - 2005-01-00
- The Iowa Electronic Market: Lessons Learned and Answers Yearned - by Joyce E. Berg and Thomas A. Rietz - PDF file - 2005-01-00
- Analysis of 2004 Political Futures Markets - by Ken Allen, Kevin Daniels, Darby Kopp and Brian Murdock - Dartmouth U. - MS Word .DOC file - 2004-11-09
- Prediction Markets: Does Money Matter? - by Emile Servan-Schreiber, Justin Wolfers, David Pennock & Brian Galebach - PDF file - Fall 2004.
- Prediction Markets - by Justin Wolfers and Eric Zitzewitz - PDF file - 2004-05-00
- Interpreting the Predictions of Prediction Markets - by Charles F. Manski - PDF file - 2004-02-00
- Historical Prediction Markets: Wagering on Presidential Elections - by Paul W. Rhode and Koleman S. Strumpf - PDF file - 2003-11-10