It’s hard to ignore the accumulating bodies, including, may they rest in peace, PPX, Hubdub, Protrade, Tradesports, Newsfutures, Hedgestreet, Yoonew, TheTicketReserve, FirstDibz, BettorFan, ipreo, Tech Buzz Game, The WSX, Storage Markets, FTPredict, real HSX, BizPredict [1], CasualObserver.net, Cenimar, Alexadex [2], Askmarkets, Truth Markets, BetBubble, Betocracy, CrowdIQ, Media Mammon, Owise, RIMDEX, Trendio [3], TwoCrowds, BBC celebdaq/sportdaq, Betfair Predicts, chrisfmasse.com [4], and more.

Is this churn rate normal for startups in general, even healthy? Is it a sign of PM’s place in the trough of the hype cycle? Is the current climate an opportunity for those left standing or someone new? Or does it simply suggest that prediction market proponents like me have lost?

A number of media-PM partnerships which on their face seem perfectly natural are history: USA Today+Newsfutures, Popular Science+HSX, Business 2.0+ConsensusPoint, Financial Times+Intrade, Techcrunch+Askmarkets [5], ABC7+Inkling [6], and CFO Magazine+Crowdcast.

At least two former PM companies found success only after switching gears: Protrade became Citizen Sports before being acquired by Yahoo! and Nigel euthanized Hubdub to focus on FanDuel. Cocision, launched just last fall, has already abandoned its PM roots in favor of breezy Q&A and voting.

Usable Marketeer Alex Kirtland nails exactly why all the “predict Wall Street” games may be fun but aren’t likely to be predictive. Research papers, including my own, report that the accuracy advantage of prediction markets, while real, may often be small compared to statistical models or polls.

Intrade, one of the most cited and well studied PMs, is trying hard with a radical remake that looks great and a new fee structure that’s likely to improve low-probability predictions. I don’t have any inside knowledge but the company and the exchange don’t seem especially strong; I even spotted some bugs in their exchange rules. The venerable Iowa Electronic Market and Foresight Exchange that, together with Robin, started it all, look, well, venerable. Betfair is still a powerhouse and soared in its IPO just last fall, but is perhaps showing signs of age as personnel turn over and the product remains decidedly 1.0.

A few startups like Crowdcast, MediaPredict, smarkets, betable, socialico/PremierX, and InklingMarkets are nimble and promising, but none have hit home runs yet. The SimExchange is well designed and chugging along. Bet2Give [7] and CentSports are both fascinating concepts and still alive, two of the most intriguing real-money markets. Others like ExtZy, RealityMarkets and PublicGyan are hanging on. New entrants like Prediculous, Predictalot, Predictopus, 4cast, beansight, I Called It, IBET, Prediction Book, HuffPo’s Predict the News, Slate’s Lean/Lock, Ultrinsic, Knew The News, Cantor Gaming’s Oracle [8], and the MNI Forecast Competition (Lumenogic) are still coming up, though at an admittedly slower pace than four years ago.

Update 2011/5/10: Crowdpark, a German company with an office in San Francisco, launched in English last December with a web game and an impressive, well-designed Facebook game that’s already attracted 500,000 monthly active users, the 11th fastest growing Facebook app in April. They have an interesting “patent pending” automated market maker that I can’t find any details about (yet).

One PM mailing list is of questionable transparency and another is often silent. The Prediction Market Industry Association is inactive.

The final post on Newfutures Blog in 2009 declares that “resistance is futile”. But is it the world’s resistance of PMs, or PMs resistance of irrelevance, that is futile?

Despite the negative tone of this post, I believe it’s the former. The prediction market spring will come. Here’s why. Prediction markets offer:

1. Accountability
2. Meritocracy
3. A marketplace to reward information release
4. Real-time updates
5. Accuracy
6. Increasing ease of use, as the technology matures and diffuses
7. Self funding

No other prediction technology offers the same. There’s a great opportunity here for the companies that have squirreled away enough nuts to survive the winter.

P.S. Also read Paul Hewitt’s Prediction Market Prospects 2010.

[1] In 2006, the teaser prediction for BizPredict was “Do you know when MySpace’s traffic will surpass Yahoo’s?”.

[2] Techcrunch declared Alexadex “the web 2.0 stock market”, back when Techcrunch encouraged Diggs

[3] I like Trendio’s post-mortem:

..Trendio rapidly became popular and attracted massive traffic from all over the world, as well as attention from major newspapers, TV-channels and blogs. To develop Trendio as a large-scale web property and an income-generating business would however have required to dedicate time and resources that I wasn’t able to provide.

I still believe there is a massive potential for prediction markets, both as games and for their predictive power…

[4] A truly sad loss, and not just because of the 2005 awards. Someone should archive the archive to be sure this gem, as information-rich as it was verbose and disorganized, survives. Hang in there Midas Oracle!

[5] Ironically, upon launch of Askmarkets in 2008 Techcrunch asked “who’s going to the deadpool?”

[6] Technically not dead, but seems neglected.

[7] We independently considered an idea similar to bet2give at Yahoo! in 2007 but never pursued it.

[8] Cantor Gaming’s odd-setting mechanism seems effectively like an automated market maker with intelligent prior.

Scott Aaronson is a skeptic, to say the least. He made an amazing public bet to demonstrate his confidence. He pledged that if Deolalikar wins the $1 million prize, Aaronson will top it off with $200,000 of own money. Even more amazing: Aaronson made the bet without even reading the proof. [Update: I should have said "without reading the proof in detail": see comments] (Perhaps more amazing still: a PC World journalist characterized Aaronson’s stance as “noncommittal” without a drip of sarcasm.) [Hat tip to Dan Reeves.]

As Aaronson explains:

The point is this: I really, really doubt that Deolalikar’s proof will stand. And while I haven’t studied his long, interesting paper and pinpointed the irreparable flaw… I have a way of stating my prediction that no reasonable person could hold against me: I’ve literally bet my house on it.

Aaronson is effectively offering infinite odds [Update: actually more like 2000/1 odds: see comments] that the question “P=NP?” will not be resolved in the near future. Kevin McCurley and Ron Fagin made a different (conditional) bet: Fagin offered 5/1 odds (at much lower stakes) that if the question is resolved in 2010, the answer will be P≠NP. Bill Gasarch says that he, like Aaronson, would bet that the proof is wrong… if only he were a betting man. Richard Lipton recounts a discussion about the odds of P=NP with Ken Steiglitz.

But beyond a few one-off bets and declarations, where is the central market where I can bet on P=NP? I don’t even necessarily want in on the action, I just want the odds. (Really!)

My first thought was the Foresight Exchange. It does list one related contract — Good 3SAT Algorithm by 2020 — which should presumably go to zero if Deolalikar’s proof is correct. It hasn’t budged much, consistent with skepticism (or with apathy). My second thought was the PopSci Predictions Exchange (PPX), though sadly it has retired. InklingMarkets has a poll about whether P=NP will be resolved before the other Clay Institute prize questions, but not about how it will be resolved or the odds of it happening. (The poll is one of several markets sponsored by the Woodrow Wilson Center’s Science and Technology Innovation Program — hat tip to Vince Conitzer.) I don’t see anything at longbets, and anyway longbets doesn’t provide odds despite it’s name.

In 1990 Robin Hanson provocatively asked: Could gambling save science?. That question and his thoughtful answers inspired a number of people, including me, to study prediction markets. Indeed, the Foresight Exchange was built largely in his image. P=NP seems one of the most natural claims for any scitech prediction market.

All these years later, when I really need my fix, I can’t seem to get it!

If it wasn’t clear in my original post, I found Aaronson’s bet incredibly useful and I am thrilled he did it. I believe he should be commended: his bet was exactly what more scientists should do. Scientists should express their opinion, and betting is a clear, credible, and quantitative way to express it. It would be as shame if some of the negative reactions caused him or others not to make similar bets in the future.

I just wish there were a central place to make bets on scientific claims and follow the odds in the vision of Robin Hanson, rather than every scientist having to declare their bet on their own individual blogs.

This month I’ve had five times more traffic than in any other month since I began blogging in Oct 2006, even during woblomo.

Why? I paid Paul Graham a compliment that struck a minor viral nerve, spreading through twitter, facebook, and blogs and sending over six thousand people my way on July 16 alone according to quantcast. Of course most have since dispersed.

Power on the web flows backward through referrals to the sites that people begin their day with, the sources of traffic. Referrals from social media, unpredictable and bursty though they may be, are inexorably on the rise. As they grow, power will shift away from search engines, today’s referral kings. Who knows, this may embolden publishers to take previously unthinkable steps like voluntary delisting, further eroding the value of search. This has all been said before, perhaps best by Mark Cuban starting in 2008. It would be a blow to openness and hurt users, but would spark a fascinating battle.

Another meta note: I installed a new WordPress theme: Suffusion. It’s fantastic: endlessly configurable, bug free, fast, and well designed. I happened upon it by accident when WP 3.0 broke my old theme and I couldn’t be happier. Apparently written by a teenager, I donated to his beer, er, coffee fund.

In the eyes of a casino, a sharp is indistinguishable from a cheat. More than boring, this seems fundamentally unfair and unsustainable, inviting disguise. It also turns off a wealthy, influential, and game-loving segment of the population.

What I want: A casino by geeks for geeks that celebrates innovation, encourages cleverness, welcomes gadgets and wifi, and fosters hacking, outwit, and outplay.

At least one casino has seen the light. The M Casino in Las Vegas is parterning with Cantor Fitzgerald to support in-game sports betting with few rules and caps, inviting sharps to, more or less, “bring it on”.

…gamblers can bet on the game even during play, accepting ever-changing point-spreads and odds. They can invest money on a Knicks foul shot going through the hoop or a Dodger getting to first base — contending with ever-evolving odds.

More critically, bettors can create hedges while jumping in and out of positions. But instead of buying into the fast-breaking moves of Microsoft, they’re betting on the Mariners’ impending fortunes.

This form of wagering is new to Las Vegas but old-hat in other markets.

…unlike in most other casinos, laptop computers are welcome.

…”The M wants [sharp bettors] to be there,” believes [professional sports-bettor Steve] Fezzik. “They want your information, and that’s a progressive attitude.”

Kudos to M for taking a chance on a more interesting future and to Cantor for making it happen.

What Cantor is debuting may not be a whole lot more than betfair indoors, but it’s a long overdue start. Here’s to hoping we see even more innovation, including smarter and more expressive markets.

At least one person.

Paul Graham wins the award for the most prescient parenthetical statement inside a footnote ever.

In footnote 14 of Chapter 5 (p. 228) of Graham’s classic Hackers and Painters, published in 2004, Graham asks “If the the Mac was so great why did it lose?”. His explanation ends with this caveat, in parentheses:

And it hasn’t lost yet. If Apple were to grow the iPod into a cell phone with a web browser, Microsoft would be in big trouble.

Wow. Count me impressed.

To find this quote, search inside the book for “ipod cell”.

To get into a 2004 midset, look here and here.

In December, before Avatar was released and while some still thought it more likely to sink than swim, Slate journalist Josh Levin asked us to predict its opening weekend box office earnings using our models. We projected between $65 and $84 million. The actual number? $77 million.

Confession: In this post I am guilty of exactly the sins I’ve complained about in the past: cherry picking positive outcomes in hindsight, and measuring probabilistic predictions categorically and in isolation. Oops.

1) George “Greek geek” Tziralis’s openfund; 2) Kevin Dick’s Black Swan Fund [via Daniel Horowitz]; and 3) the Awesome Foundation [via Foo Camp list].

The beginning of a trend?

Update 2010/03/19: The Black Swan fund, now called RightSide Capital is open for business.

___________

*Yet still no micropayments!