All posts by David Pennock

Predicting media success

Often, predicting success is being a success. Witness Sequoia Capital or Warren Buffet.

In the media industry (e.g., books, celebs, movies, music, tv, web), predicting success largely boils down to predicting popularity.

Predicting popularity would be wonderfully easy, if it weren’t for one inconvenient truth: people herd. If only people were as fiercely independent as they sometimes claim to be — if everyone decided what they liked independently, without regard to what others said — then polling would be the only technology we would need. A small audience poll would foreshadow popularity with high accuracy.

Alas, such is not the case. No one consumes media in a vacuum. People are persuaded by influencers and influenced by persuaders. People respond in whole or in part to the counsel of critics, peers, viruses, and (yes) advertisers. So, what becomes popular is not simply a matter of what is good. What becomes popular depends on a complex dynamic process of spreading influence that’s hard to track and even harder to predict.

Columbia sociologist (and I’m happy to note future Yahoo) Duncan Watts and his colleagues conducted an artful studydescribed eloquently in the NY Times — asking just how much of media success reflects the true quality of the product, and how much is due to the quirks of social influence. In a series of carefully controlled experiments, the authors tease apart two distinct factors in a song’s ultimate success: (1) the inherent quality of the song, or the degree people like the song if presented it in isolation, and (2) dumb luck, or the extent the song happens by chance to get some of the best early buzz, snowballing it to the top of the charts in a self-fulfilling prophesy. Lo and behold, they found that, while inherent quality does matter, the luck of the draw plays at least as big a role in determining a song’s ultimate success.

If so, Big Media might be forgiven for their notoriously poor record of picking winners. Over and over, BM hoists on us stinkers like Gigli and stale knockoffs like Treasure Hunters. (In prediction lingo, these are false positives.) At the same time, BM snubbed (at least initially) some cultural institutions like Star Wars and Seinfeld. (False negatives.)

So, are media executives making the best of a bad situation, eking out as much signal as possible from an inherently noisy process? Or might some other institution yield forecasts with fewer false-atives?

I think you know where this is going. Prediction markets for media!

Media Predict is exactly that: a new prediction market aimed at forecasting media success. I’d like to congratulate founder Brent Stinski on a spectacular launch done right. Media Predict sprinted out of the gates with a deal with Simon & Schuster’s Touchstone Books and a companion piece in the NY Times, spawning coverage in The Economist and NPR. (Also congrats to Inkling Markets, the “powered by” provider.) More importantly, the website is clean, clear, complete (enough), and ready for launch.

I first met Brent Stinski in 2006 at Collabria’s NYC Prediction Markets Summit and his concept impressed me. Among the flury of recent play money PM startups, Media Predict’s business plan seems one of the most credible. The site taps simultaneously into the wisdom of crowds ethos, the user-generated content explosion, artists’ anti-establishment streak, and the public’s ambivalence toward Big Media. (The latter two factors are epitomized no more vehemently and eloquently than in an essay by Courtney Love, and stoke the fires of sites like Garage Band, Magnatune, Creative Commons, Lulu, Kinooga, and even MySpace, not to mention mashup fever, open source, anti-DRM-ism, etc.)

The New York publishing world is ridiculing Simon & Schuster for ceding its editorial power to the crowd. (In fact, S&S reserves the right to choose any book or none at all.)

Time will tell whether prediction markets can be better than (or at least more cost effective than) traditional media executives. One thing is for certain: one way or another, the power structure in the publishing world is changing rapidly and dramatically (no one sees and explains this better than Tim O’Reilly). My bet is that many artists and consumers will emerge feeling better than ever.

Hacked and splogged and left for …

Yesterday I was hacked.

More specifically, my web hosting service DreamHost was hacked and Oddhead Blog was hijacked. Someone stole a bunch of passwords and methodically replaced index.* files, including the index.php file in my wordpress directory. If you visited this blog yesterday, this is what you saw.

Also yesterday, I noticed that I’ve been splogged. (Splog = spam + blog.)

The strange part about both incidents is that neither attack has an obvious motive. I don’t see any blatant ads or links or any real benefit that the attacker gained. Probably SEO related, but I just don’t see it.

Tough neighborhood, these Internets.

Thoughts from WWW2007 on web science, web history, and misc

WWW2007 LogoEarlier this month, I spent a few days in lovely Banff, Alberta, Canada, at WWW2007, the 16th International World Wide Web Conference. Here are my thoughts from the event. [See also: Yahoo! Research’s writeup.]

It’s becoming clear that other sciences beyond computer science, including economics and sociology, are necessary for understanding the web and realizing its full potential. This theme ran through both Tim Berners-Lee’s and Prabhakar Raghavan’s plenary talks. For every new advance in the web, once it reaches critical mass, the economic incentives to manipulate the system inevitably emerge. Email led to spam. Altavista led to keyword spam. Google led to link spam. Blogs led to comment and trackback spam. Folksonomies led to tag spam. Recommender systems and aggregators (e.g., Digg) led to shilling. It’s clear that a better understanding of incentives, game theory, and system equilibrium is needed, beyond just cool engineering feats. The University of Michigan calls this incentive-centered design and has a world-class research team exploring the topic; see Jeff MacKie-Mason’s blog ICD Stuff for an interesting and accessible discussion. Yahoo! Research is also betting on the importance of human incentives, building a group of economists and sociologists to complement our contingent of computer scientists.

Among conference events, nowhere was the convergence of economics and computer science more clear than at the Third Workshop on Sponsored Search Auctions. The workshop is a rare venue where terms like Nash equilibrium and NP-complete can coexist in harmony. The workshop explored the intricacies of web search advertising, a multi-billion dollar industry experiencing rapid growth. Contributions included new designs for auctioning off advertising space, new analyses of the systems currently used by search engines, new tools to help advertisers, and empirical studies of the industry. Participants included representatives from both academia and industry, including economists, computer scientists, search engine employees (including representatives from the “big three”: Google, Microsoft, and Yahoo!), and search engine marketers. Yahoo! had a large presence at the workshop: Yahoo! scientists (including me) served on the organizing committee, Yahoo! employees and interns presented six of the fourteen peer-reviewed papers, and many Yahoos attended, contributing to their voice to the discussion of this emerging field.

Bradley Horowitz‘s talk also emphasized the new web order, where artists are needed as much as technologists: artists who can envision, create, and orchestrate online communities can be the difference between mass adoption and a flop.

An interesting addition to the WWW program was the Web History track and the Web History Center. Some of the talks were fascinating. Hermann Maurer recounted stories of interactive TV products that proliferated in Europe in the 1970’s and that mirrored almost everything that is done on the Web today in a primitive form. [Some keywords to search for if you’re interested: PRESTEL, Teletel/Minitel (France), MUPID (Austria).] For example, one massive multiplayer game, which involved social exploration of 64 million virtual planets, each with a hidden secret, was so wildly popular that it crashed the network. The apparent winner of the contest returned his prize, admitting that he didn’t actually solve for the secrets, but rather hacked into the system and reverse engineered the code. This pre-Internet system even featured some things I’m still waiting for on today’s web, like micropayments.

My first best answer

I felt bad about this. So I made sure to answer this. And whaddya know?: they like me, they really like me!


——– Original Message ——–
Subject: Yahoo! Answers: Your answer has been chosen as the best answer
Date: 24 Apr 2007 09:44:59 -0700
From: Yahoo! Answers
To: pennockd

Hey, Dave, look what you got!

Congratulations, you’ve got a best answer and 10 extra points!

Your answer to the following question really hit the spot and has been chosen as the best answer:

Who will win in 2008 and why (real answers)?

Go ahead, do your victory dance. Celebrate a little. Brag a little.
Then come back and answer a few more questions!

Take me to Yahoo! Answers

Thanks for sharing what you know and making someone’s day.

The Yahoo! Answers Team

Get the Yahoo! Toolbar for one-click access to Yahoo! Answers.



My Yahoo! Answers Stats
So now I’m 1 for 1! I can see how this gets addictive.

Betting on Sirius and XM to … die

One of the great things about intrade (recently split from TradeSports) is that they are open to suggestions from wide-eyed academics. For example, at Justin and Eric‘s urging, intrade listed several simple combinatorial markets, including baskets of states (e.g., “FL+OH”) in the 2004 US Presidential election and an October surprise market probing for a statistical correlation between Bush’s 2004 reelection and bin Laden’s capture.

Recently, again at Eric and Justin’s request, intrade launched a Sirius-XM merger market to predict whether the two satellite radio companies’ wedding vows will be blessed by the U.S. Department of Justice and the Federal Communications Commission.

The picture of XiriuM as a powerful monopoly threatening consumer choice is, to put it bluntly, laughable.

why would I pay for satellite programming when I can simply hop onto Internet radio?

If the DOJ nixes this merger, it can be due only to a horrible misunderstanding of the march of communications technology. One by one, nearly every communications medium is converging to operate “over IP”: data, voice, music, print, TV, video, you name it. Audio in your car should be no exception. Does anyone doubt that sooner rather than later every car (indeed every person) will be connected to the Internet? Then why would I pay extra (a good deal extra if the naysayers are to be believed) for one-size-fits-all satellite programming when I can simply hop on the Internet and tap into my personalized Lauchcast radio or my iTunes account? Orbital space machinery must weigh a little more heavily on the balance sheet than rack space in Quincy: how will XiriuM possibly compete once Internet radio has equal access into consumers’ cars?

The problem I see for XiriuM is that one-way purely broadcast technologies are nearing extinction. Even if some media don’t directly utilize the Internet or even TCP/IP, they will almost surely use a two-way communications link of some kind. Why? Ostensibly, because consumers want personalization and interactivity. Perhaps more to the point, because publishers and advertisers want better targeting and performance metrics.

The only “way out” I see for XiriuM is to actually become an Internet service provider for cars, much like the (formerly broadcast-only) cable companies did, for example by bundling high speed satellite downloads with a low bandwidth cellular uplink. Even so, I imagine that latency would be a serious problem, as with HughesNet (formerly Direcway) satellite Internet service, meant for use in rural areas with no broadband alternatives.

So, although I have no idea how DOJ will rule, and thus have no advice for intrade bettors, I do know how DOJ should rule: “sure, knock yourselves out”. Plus I have some throw away advice for SIRI and XMSR shareholders:… Sell!

Pushing email

DictionaryRecently my daughter, nearing 2 1/2, was playing with an old laptop we keep in the family room. She was pressing keys and buttons to varied effect, her giggles contagious. Suddenly she called out, “I’m pushing email! I’m pushing email!” My wife & I couldn’t stop laughing. We had never explicitly taught her the word “email”, though she had clearly caught on to that thing that mommy does in the office every day or so.

The phrase “pushing email” makes perfect sense to a toddler, to whom a computer is simply a toy with more buttons than usual.

But that got me thinking: The phrase also makes perfect sense to an email-drenched 36 year old. “Pushing” is exactly what emailing feels like. The constant influx in various queues (work, personal, filtered), to be dealt with one at a time: Delete? File? Mark? Reply? Hold? Route? More than any other communications medium, email involves connecting one peer to another: introducing, forwarding, routing, re-routing, and mediating. At any given time, hundreds of threads intersecting me may be in midstream somewhere awaiting a “push” from someone (usually me!). Not to mention the physical aspects of typing and mousing.

I can’t imagine a better extension of the inbox/outbox metaphor than the image of pushing electronic papers around.

In keeping with my self-appointed hobby of amateur lexicographer (I know, I know: keep my day job), I’m going to start using the phrase. IMHO it’s both more fun and more accurate than the alternatives I can think of: “checking”, “answering”, “doing”, “dealing with”, etc.

Gotta run. You know why.

Lance Fortnow, 2002-2007


0000

0001 Recently

0010 Lance Fortnow

0011 retired from blogging.

0100 Computer scientists everywhere mourn.

0101 Was one of the first.

0110 Still is one of the best.

0111 At one time topped search “web log”!

1000 A great voice a great craftsman, search great theoretician

1001 Goodbye blogger Lance your wit and wisdom sorely missed

1010 Goodbye blogger Lance your pagerank link juice refer power withdrawn

1011 Update: Twain Jobs Favre now Fortnow: return! Demise reports exaggerations great

Bix's American Idol prediction market

When one corporate fish swallows another, a lot can happen. Sure, temporary indigestion, remorse, culture clash, layoffs, posturing, Borg assimilation, chaos, panic, flight, or even disaster may ensue. More likely the carnivore hiccups and life moves on. But, in rare cases, the kid fish just so happens to be a visionary thinker and kickbutt coder with exactly the right skills and temperament to turn mama into a bigger, badder, better, and youthier fish, newly invigorated for survival in the pond. Witness Microsoft’s Ray Ozzie and Yahoo!’s Flickr-ization.

Now Yahoo! has a new Bixation.

I recently had the pleasure of visiting Bix at their (old) headquarters in the heart of downtown Palo Alto. These folks are impressive. Simply put, they build cool stuff, fast. The typical product cycle?: Two weeks. They grok the rinse and repeat development cycle of the new web world and, more importantly, have the experience and talent to pull it off. Oh, and this can never hurt: they’re supremely smart.

Case in point: Two supremely smart Bixies — John Hayes and Mike Speiser — developed a supremely cool prediction market from the ground up in about two weeks of spare cycles. (To predict the American Idol winner, of course: what else?) Check out the brilliantly simple one-page UI, powered by ajax-ian magic. The attention to detail is clear, from the inline sparkline graphs, to the minimalist yet clear descriptions.

Bix American Idol Prediction Market Screenshot -- Doolittle

Under the hood, the site is running independent Hanson market makers for each contestant. The payoff structure is designed to predict a full ranking, projecting the eventual winner as well as the expected losers each week. Play around with it and see what you think. John and Mike would love your feedback — to a large extent user reactions will drive where this project goes next.

CFP: Second Workshop on Prediction Markets

We’re soliciting research paper submissions and participants for the Second Workshop on Prediction Markets, to be held June 12, 2007 in San Diego, California, in conjunction with the ACM Conference on Electronic Commerce and the Federated Computing Research Conference. The workshop will have an academic/research bent, though we welcome both researchers and practitioners from academia and industry to attend to discuss the latest developments in prediction markets.

See the workshop homepage for more details and information.

You can signal your intent to attend at upcoming.org, though official registration must go through the EC’07 conference.