Category Archives: advertising

Turning in my Yahoo! badge

Last day: Turning in my Yahoo! badge after 8 or 10 years, depending how you countOn Thursday April 26, 2012, I resigned from Yahoo! after nearly 10 without actively changing jobs. Here is the full text of the goodbye letter(s) I sent. It’s the kind of long-winded last salvo that few people actually read, and now I’m foisting it upon you, dear reader, but I can’t help myself. Writing it brought back many wonderful memories and a tinge of sadness at the end of a truly amazing work environment for me, but I found the exercise rewarding. I really appreciate the many kind words and well wishes: some were poignant and immensely gratifying. The feeling is mutual. If nothing else, throughout my career I have had the great fortune of working with amazing people who are equal parts brilliant, effective, and nice, including my bosses, peers, reports, and students.

——– Original Message ——–
Subject: last Yodle (and last corny Yodle joke)
Date: Wed, 25 Apr 2012 16:44:31 -0400
From: David Pennock

After 8 wonderful years (almost 10 if you include Overture), it is with
very mixed emotions that I leave Yahoo!. My last day is tomorrow,
Thursday April 2526. You can reach me in plenty of ways and I hope you do:

[my email address]
+1-732-XXX-XXXX
Y!IM pennockd | facebook pennockd | twitter pennockd | linkedin
http://dpennock.com | http://blog.oddhead.com

I’ve grown to love this company (purple blood, yada yada) and one of the
deep ironies is that I have a feeling Scott Thompson may actually know
what he is doing and that maybe just maybe Yahoo!’s return to revenue
growth and good public perception will finally come (note I didn’t say
return to profitability — a steady $1 billion in cashmoney profit in
our pocket every year is very far from shabby). I plan to hold on to
some of my stock.

In the early 2000s Google was an amazing Bem+Wom story yet almost no one
(me included) had a clue how they would make money. In 2002, Gary Flake
introduced me to Overture, a company already making hundreds of millions
on search, and suddenly it was clear. I joined Gary in what became
Overture Research and later, under Usama Fayyad’s protective wing, the
inception of “Yahoo! Research Labs”. When Gary left, we hired Prabhakar
and Ron. The rest is history. Andrei, Andrew, Raghu, Ravi, Ricardo,
Preston, Duncan. An absolutely amazing place that was my pleasure to
watch grow and mature. I still remember the excitement of our first
offsite at Half Moon Bay to map out the future of the place.* I remember
a fateful week when Preston, Duncan, and David Reiley simultaneously
gave up their tenure to stay at Yahoo!.

From the beginning Prabhakar saw the importance of including social
science research in the mix for online media. In my little corner, where
we mixed computer science and economics (“algorithmic economics” we
called it), I believe we had enormous effect both internally and
externally. In 2007, Jeff MacKie-Mason, one of our Big Thinker lecturers
and now Dean of the School of Information at the University of Michigan,
wrote (ok, informally to me in email) that our group was “the most
exciting and successful group I’ve seen crossing the CS/Econ boundary”.
If imitation is the sincerest form of flattery, I believe we had a
significant positive impact on the growth in hiring in the social
sciences and in algorithmic economics at both Google and Microsoft. In
our group alone, we published more than 70 papers including at least two
award winners (Arpita just this year). We literally wrote the book
(chapters) on sponsored search and prediction markets. We co-founded the
Ad Auctions Workshop and NYCE Day. People who left often did
fantastically well, including Yiling Chen to Harvard, Mohammad Mahdian
to Google, and Dan Reeves to found his own successful startup Beeminder.
We filed dozens of patents (take that fb!). Former intern Nicolas
Lambert who is now a Stanford professor once told me he hoped to one day
say “it all started at Yahoo!”. I just left a Ph.D. student’s defense
whose three (!) weeks at Yahoo! were good for two chapters in his
thesis. We’ve had academic visitors leave after a week here and follow
up that they wanted to apply for a job — the environment was that great.

Inside Yahoo!, we worked on sponsored search (“squashing” and so much
more by the incomparable Sebastien Lahaie, who we recently discovered is
the central hub of research in New York), display ads, and UGC among
many topics. My passion has been in prediction (markets), and some of my
best memories have been trying to play product manager for a day (or a
couple months) for Predictalot and The Signal. Often it felt more like
operating a startup but with incredible advantages in resources, people,
and of course access to that monster traffic firehose. This was Yahoo!
at it’s best — marshaling talent from all over the globe in many
divisions and specialties to produce a product that no one had ever seen
before, and that no one including us even knew would work. One of the
saddest parts of departing now is leaving The Signal behind, an
incredible effort and in many ways our biggest and best, led by David
“force-of-nature” Rothschild and so many people behind it. Sadly, some
were let go and others are leaving on the own accord, and we’ll never
know what could have been in a counterfactual universe. Yet I believe
The Signal will live on in the good hands of those who remain, including
Chris Wilson, Alex, Ingemar, and the absolutely phenomenal Bangalore team.

By far the best part of working at Yahoo! was the people. It’s been my
pleasure to work with so many fantastic colleagues in Labs and
throughout the company. In the recent turmoil many in Labs have been, as
Preston said, “evaluated by the market”, and came out looking pretty
darn good, with calls, interviews, and offers from the best companies
(Facebook, Google, Microsoft) and universities. Early on we set a goal
to always hire above the mean, and I truly believe we did that. (Having
been here from the beginning, you can see where that leaves me in this
incredible crowd.) It’s a cliche but a true one: I am only as good as
the people working with me, and I’ve truly been blessed with amazing
colleagues, bosses, employees, postdocs, and interns. To Sebastien,
Arpita, Giro, and David Rothschild, plus Mridul, Navneet, Sudar, Arun,
Shrikant, Kim, Chris, Janet, Ron, Michael and dozens more and everyone
who has come before, from Preston & Prabhakar on down, I can’t thank you
enough and I owe you almost everything.

Goodbye for now,
Dave

* For history buffs, these were the people at the initial Yahoo!
Research offsite: Prabhakar Raghavan, Dennis DeCoste, David Pennock,
Omid Madani, Shyam Kapur, Andrew Tomkins, Winton Davies, Ravi Kumar,
Bernard Mangold, Ron Brachman, Marc Davis, Michael Mahoney, Kevin Lang,
Seung-Taek Park, and Dan Fain.

** I also remember the first few days of Yahoo! Research New York in
2005, with just Ron, John, and I. It’s amazing to see what we have
become since.

*** An even more arcane note of history: the Overture control room made
a cameo as NASA Mission Control in James Cameron’s 2003 movie Ghosts of
the Abyss. I am on somewhere on the cutting room floor trying to muster
that awestruck look one gets upon seeing alien life for the first time.

——– Original Message ——–
Subject: one more thing
Date: Thu, 26 Apr 2012 11:20:01 -0400
From: David Pennock

I’ll abuse my final act of spam to add one more thing. For those of you
remaining, you’re in good hands with Ron. I believe he can do something
special with Labs. In case you’re not familiar with his background, Ron
is frighteningly smart (Princeton undergrad, Harvard Ph.D.), was a
pioneer in artificial intelligence, wrote a seminal book on Knowledge
Representation, served as President of AAAI, the main AI society, ran
research groups at Bell Labs & AT&T, and is a highly organized, fair,
diligent manager who listens actively, gets things done, and, in
addition is a genuinely nice person. Best of luck to everyone.

Next post: A dream job come true.

2011 ACM Conference on Electronic Commerce and fifteen other CS conferences in San Jose

If you’re in the Bay Area, come join us at the 2011 ACM Conference on Electronic Commerce, June 5-9 in San Jose, CA, one of sixteen conferences that comprise the ACM Federated Computing Research Conference, the closest thing we have to a unified computer research conference.

The main EC’11 conference includes talks on prediction markets, crowdsourcing, auctions, game theory, finance, lending, and advertising. The papers span a spectrum from theoretical to applied. If you want evidence of the latter, look no further than the roster of corporate sponsors: eBay, Facebook, Google, Microsoft, and Yahoo!.

There are also a number of interesting workshops and tutorials in conjunction with EC’11 this year, including:

Workshops:

  • 7th Ad Auction Workshop
  • Workshop on Bayesian Mechanism Design
  • Workshop on Social Computing and User Generated Content
  • 6th Workshop on Economics of Networks, Systems, and Computation
  • Workshop on Implementation Theory

Tutorials:

  • Bayesian Mechanism Design
  • Conducting Behavioral Research Using Amazon’s Mechanical Turk
  • Matching and Market Design
  • Outside Options in Mechanism Design
  • Measuring Online Advertising Effectiveness

The umbrella FCRC conference includes talks by 2011 Turing Award winner Leslie G. Valiant, IBM Watson creator David A. Ferrucci, and CMU professor, CAPTCHA co-inventor, and Games With a Purpose founder Luis von Ahn.

Hope to see many of you there!

Workshops @ACM Electronic Commerce: Ad Auctions, Social Computing, June 5, 2011

The 2011 ACM Conference on Electronic Commerce will be held June 5-9 in San Jose as part of the ACM Federated Computing Research Conference. FCRC is a collection of seventeen computer science conferences with joint plenary speakers, this year featuring David A. Ferrucci, head of IBM’s Watson project, CMU professor and GWAP founder Luis von Ahn, and 2011 Turing Award winner Leslie Valiant. I’d love to someday see a true unified computer science conference in the style of the math or economics national meetings. Barring that, FCRC is the next-best thing. I hope more conferences will join.

The EC’11 list of accepted papers is out and the program looks great (including six papers from Yahoo! authors). And it’s not too late to submit a paper to one of the associated workshops. Two of particular interest, both on June 5, 2011, are:

Workshop on Social Computing and User Generated Content

The workshop will bring together researchers and practitioners from a variety of relevant fields, including economics, computer science, and social psychology, in both academia and industry, to discuss the state of the art today, and the challenges and prospects for tomorrow in the field of social computing and user generated content.

Social computing systems are now ubiquitous on the web– Wikipedia is perhaps the most well-known peer production system, and there are many platforms for crowdsourcing tasks to online users, including Games with a Purpose, Amazon’s Mechanical Turk, the TopCoder competitions for software development, and many online Q&A forums such as Yahoo! Answers. Meanwhile, the user-created product reviews on Amazon generate value to other users looking to buy or choose amongst products, while Yelp’s value comes from user reviews about listed services…

SUBMISSIONS DUE April 15, 2011, 5pm EDT

Seventh Ad Auctions Workshop

In the past decade we’ve seen a rapid trend toward automation in advertising, not only in how ads are delivered and measured, but also in how ads are sold… The rapid emergence of new modes for selling and delivering ads is fertile ground for research from both economic and computational perspectives…

We solicit contributions of two types: (1) research contributions, and (2) position statements…

Submission deadline: April 15th, 2011 (midnight Hawaii Time)

CS ∩ Econ news

Here are some news items about the field with no name (at least not yet, see below) that lies at the intersection of computer science and economics.

  1. The Sixth Workshop on Ad Auctions is soliciting papers. The workshop will be held June 8, 2010, in Cambridge, MA, in conjunction with the ACM Conference on Electronic Commerce (EC’10). There is a terrific organizing committee this year spanning industry and academia, CS and business schools.
  2. The EC’10 list of accepted papers is out and looks great.
  3. The first-ever Behavioral and Quantitative Game Theory Conference on Future Directions will be held May 14-16 in Newport Beach, CA. The program looks fantastic.
  4. Last fall, the University of Pennsylvania announced the first-ever undergraduate degree program in Market and Social Systems Engineering. Kudos to UPenn: the move shows impressive vision and leadership.
  5. The NSF is funding research in the CS-Econ area. They support efforts to “explore the emerging interface between computer science and economics, including algorithmic game theory, automated mechanism design, computational tractability of basic economic problems, and the role of information, trust, and reputation in markets” (page 7).
  6. The NBER Market Design working group is soliciting papers for a workshop October 8-9, 2010 in Cambridge, MA.
  7. We are now reviewing some amazing submissions to Yahoo!’s 2010 Key Scientific Challenges program. Read the challenges for the area we call Algorithmic Economics.
  8. Members of Yahoo! Labs can submit proposals to fund collaborative research with academic colleagues through the Yahoo! Faculty Research and Engagement program. If you’re interested, contact a Yahoo! Labs employee.

What should be the name? CS ∩ Econ is accurate but cryptic. At Yahoo!, we call it Algorithmic Economics. At Google, they call it Market Algorithms. The ACM Special Interest Group in this area calls it Electronic Commerce, causing complaints every year. I’ve heard people suggest Economics and Computation. The name Algorithmic Game Theory has emerged as something of a standard within the CS theory community. [Update: Noam suggests Algorithmic Game Theory and Economics and even renamed his blog accordingly.] The phrase Computational Economics makes sense but is already in use by a different field. A fun suggestion is Economatics (or Autonomics), meant to invoke a mashup of economics and automation.

Prediction markets had a similar naming/identity crisis. They’ve been called information markets, idea markets, securities markets, event markets, binary options, market in uncertainty, and more. But now almost everyone has settled on prediction markets. I’ve come to like the name and I think it’s helped establish the field in it’s own right. I hope we can settle on a good name for CS ∩ Econ in part so we can create the Journal of PerfectNameForCSEcon, an outlet sorely missing from the field.

Update 2011/10/11: The journal now exists! Called the ACM Transactions on Economics and Computation, it circumvented the naming issue.

Upcoming CS-econ events: New York Computer Science and Economics Day and ACM Conference on Electronic Commerce

1. New York Computer Science and Economics Day (NYCE Day)

Monday, November 9, 2009 | 9:00 AM – 5:00 PM
The New York Academy of Sciences, New York, NY, USA

NYCE 2009 is the Second Annual New York Computer Science and Economics Day. The goal of the meeting is to bring together researchers in the larger New York metropolitan area with interests in Computer Science, Economics, Marketing and Business and a common focus in understanding and developing the economics of internet activity. Examples of topics of interest include theoretical, modeling, algorithmic and empirical work on advertising and marketing based on search, user-generated content, or social networks, and other means of monetizing the internet.

The workshop is soliciting rump session speakers until October 12. Rump session speakers will have 5 minutes to describe a problem and result, an experiment/system and results, or an open problem or a big challenge.

Invited Speakers

  • Larry Blume, Cornell University
  • Shahar Dobzinski, Cornell University
  • Michael Kearns, University of Pennsylvania
  • Jennifer Rexford, Princeton University

CFP: New York Computer Science and Economics Day (NYCE Day), Nov 9 2009

2. 11th ACM Conference on Electronic Commerce (EC’10)

June 7-11, 2010
Harvard University, Cambridge, MA, USA

Since 1999 the ACM Special Interest Group on Electronic Commerce (SIGecom) has sponsored the leading scientific conference on advances in theory, systems, and applications for electronic commerce. The Eleventh ACM Conference on Electronic Commerce (EC’10) will feature invited speakers, paper presentations, workshops, and tutorials covering all areas of electronic commerce. The natural focus of the conference is on computer science issues, but the conference is interdisciplinary in nature. The conference is soliciting full papers and workshop and tutorial proposals on all aspects of electronic commerce.

Meet the splORGers: The latest breed of web spam parasites

Via Muthu. This is mind boggling to me.

Sparasites on the web now somehow find it worth their while to invade ultra-specialized academic conferences. Call them splORGers. (In close analogy to sploggers).

The website focs2008.org appears to be the official home of the 49th Annual IEEE Symposium on Foundations of Computer Science. (In fact, it’s the top result for the search “focs 2008” in Bing, Google, and Yahoo!.) Historically a few hundred people attend to hear talks like “A Hypercontractive Inequality for Matrix-Valued Functions with Applications to Quantum Computing and LDCs”.

The website appears fully functional: you can browse the entire website structure including internal links like the list of accepted papers and external links like the online registration form.

But look more closely at the lower left corner of the front page. What do you see? SPAM KEYWORDS!: “Data Recovery Dell Memory HP Memory PC RAM wow accounts WoW gold”.

spam keywords on splORG site focs2008.org

WTF??!!

It turns out that focs2008.org is NOT the official FOCS 2008 conference home page. Rather, it’s http://www.cs.cmu.edu/~FOCS2008/. (Yahoo! ranks this site in second place, Bing and Google in seventh.)

This doesn’t seem like a zero-cost no-brainer automated attack. It involves identifying the appropriate domain name and mirroring another website, not as one-click as it sounds. There’s even a small sign of manual effort: the fox graphic in the upper left links to focs2007.org rather than 2008, as in the original. And of course there’s the cost to register and host the domain.

So why bother? Clearly, the perpetrator is not expecting real people to click on the spam links. At it’s peak, about as many people searched for “focs 2008” as for “pennock” and the offending links are fairly obscure. This is most certainly about siphoning link juice from seemingly legitimate .orgs that search engines trust.

But can that benefit really outweigh the cost? Again and again I simply fail to grok the economics of spam.

SplORGers have also set up camp at focs2007.org and ioi2008.org. Curiously, focs2009.org has a more transparent yet still head-scratching disclaimer.

Today, I stumbled onto a similar spamfiltration on mortgagepoints.com, the first external link on the Wikipedia definition of mortgage points, prompting me to finally write this post. Look what our ultra open web has wrought!

Thank you Bangalore

Sunday I returned from a trip to Bangalore, India, where I gave a talk on “The Automated Economy” about how computers can and should take over the mechanical aspects of economic activity, optimizing and learning from data in the way people cannot, with detailed case studies in online advertising and prediction markets. You can read the abstract, watch archive video of the talk, view my talk slides, browse the official pictures of the event, or see my personal pictures of the trip.

Some say everything’s bigger in Texas (most vociferously Texans). They haven’t been to India. My talk is part of Yahoo!’s Big Thinkers India series — four talks a year from (so far) Yahoo! Research speakers. If the Thinking isn’t Big, the crowds certainly are — the events can draw close to 1000 attendees from, apparently, all over India. Duncan Watts says its the largest crowd he’s spoken too; me too. This time they disallowed Yahoo! employees to attend the main event and the hotel ballroom still filled to capacity.

Here is a linked-up version of my journal entry for the trip, a kind of windy and winded thank you letter to Bangalore. If you’re not interested in personal details, you might skip to Thoughts on Bangalore.

Getting there

The Philadelphia airport international terminal is dead empty. I breeze through security — the only one in line. I’m inside security two hours early thinking that either the recession is still in full force or traveling internationally on a Monday night out of Philadelphia is the best ever. Maybe not. Get on plane. Wait two hours on tarmac. Apparently a two hour layover isn’t enough leeway on international flights. Miss my connecting flight in Frankfurt by a few minutes. Team up with a fellow passenger in the same boat. We are rebooked via Dubai. Fly directly over Bagdad. Dubai is an impressive airport. Endless terminals lined with upscale shopping. Packed with Asians, Europeans at midnight and beyond. From there, Emerites Air to Bangalore. Only 9 hours behind schedule. Sneezing fits begin after 28 hours of airplane air.

Day 0: Yahoo! internal practice talk

Driver right there outside baggage claim, nice guy. Takes me to hotel. Over an hour. Traffic. Time for shower, NeilMed nasal rinses (bottled water), Sudafed, but not sleep. Call home. Yahoo! Messenger with Voice doesn’t roll off the tongue like ‘Skype’, but it rocks. Super clear and dirt cheap. Lauren and the girls are so sweet. Miss them. To Yahoo! office. Meet Anita, Mani. Time for Yahoo! internal version of Big Thinkers talk. Nose is still running. Drips and wipes during my talk. Talk goes well but I run out of time for prediction market section and this seems what people are most interested in. I’m glad I had the practice run to work out the kinks and rebalanced the talk. Back to hotel. Call home again for a recharging dose of home. I missed Ashley’s graduation from pre-school: she did great: they sang six songs and she knew them all. She was dressed up in a yellow cap and gown. I’m upset I had to miss such an adorable milestone but am proud of my little girl (and dismayed she is rapidly becoming not so little!). More NeilMed. Room service. (Called “private dining” here — sounds illicit.) Sleep! For a few hours at least. Wake up in the middle of the night since it’s NY daytime. Finally get back to sleep again.

Day 1: Meetings

Hard to wake up at 9am = midnight. Shower. Feel 1000% better. Driver takes me to the Yahoo! office. It’s in a complex with Microsoft, Google, Target, Dell, and many other US brands. Once you’re inside it’s like every other Yahoo! office except the food — built essentially to corporate spec. Meet with Anita, Raghu, and Rajeev: go over PR angles and they brief me on the media interviews. These guys and gal are on top of things. Meet with Mani and her team: great group. Skip intern pizza talks because I can’t eat cheese, going for the cafeteria instead. Mistake. Order a veggie grill thinking that since it’s grilled, it’s cooked enough. I only take a few bites of this before thinking it’s too risky. I eat some bread and Indian mixtures. Not sure what the culprit is but something doesn’t sit well in my stomach. Give prediction markets portion of my talk to a few interested people in labs. Very sharp group. Meet with Dinesh and Sachin, their intern, and one other. Interesting work. Meet with Chid and Preeti on Webscope. Back to hotel. Call Lauren. Good to hear her voice. Ashley wants to say hi. She’s so adorable. She finds it hilarious that I am about to have dinner while she is eating breakfast. I can hear her laughing uncontrollably at the thought. Sarah says hi too and even ends our conversation without prompting with a “bye, love you”. I go down to the restaurant for dinner. Have a chicken Indian dish with paratha (is it lachha paratha?) bread. Spicy (sweat inducing) yet so delicious. The bread is fantastic — round white with flaky layers. Back to room. TV. CNN. CNBC. ESPN. Hard to sleep. There is an incredible thunderstorm with torrents of rain. I open my balcony door briefly to catch its power. I find out later that monsoon season is just beginning. I also find out that it rained so hard and so long that the roads flooded to the point of becoming impassible. In fact, Anita, the Bangalore PR lead, had a near-disastrous experience in the rapidly flooding streets on her way home and had to turn back and check into a hotel before going home briefly in the morning and then back to Yahoo! for our am meeting. Finally get to sleep.

Day 2: My talk!

Hard to wake up at 8:30am too. Talk’s today! Nerves begin. Media interviews are first! Even worse. Turns out they went fine. Two nice/sharp reporters, especially the second one who really knows her stuff and spoke to us (Rajeev and I) for 1.5 hours. She’s especially interested in the prediction market stuff since that is something new. She may write two articles (for Business World India). Lunch, then a bit of time to rest and freshen up. Stomach is not doing well. Pepto to the rescue. Back down to lobby. They take my picture in the courtyard. Then into the ballroom. Miked. Soundchecked. They accept a final last minute change to my slides: hooray! Room starts filling. 100 people. 200. 300. Now 500. It’s time to start! Rajeev gives a very nice intro. I walk up the stairs onto the stage. I’m miked, in lights, speaking in front of 500 people expecting a Big Thinker. Here I go! “Four score and seven years…” Ha ha. Actually: “Thanks Rajeev, and thanks everyone for your time and attention. I am happy and honored to be here. I’m going to talk about trends in automation in the economy…”

David Pennock speaking at Yahoo! Big Thinkers India June 2009Audience at Yahoo! Big Thinkers India June 2009

65 minutes later “Thank you very much.” Applause. I think it went well: one of my better talks. I covered everything, including the prediction market stuff. It turns out, like at Yahoo!, and like the journalists, the audience is more interested in prediction markets than advertising. Lots of questions. Some I follow, some I can’t parse the words, others I hear the words but just don’t understand. I do my best. Several people mention they follow my blog: gratifying. After the official Q&A session ends, there is a line up of folks with questions or comments and business cards. It’s the closest I’ll ever be to a rock star. A handful of people wait patiently around me while I try to get to everyone. Eventually the PR folks rescue me and take me to a “high tea” event with Yahoo! Bangalore execs and some recruiting targets. Relief and euphoria kick in. It’s over. I talk with a number of people. I make my exit. Private dining. Call home. Lauren has explained to Ashley that I am on the other side of the world, so when she has the sun, I have the moon. So I can hear Ashley asking in the background, “does Daddy have the moon?” I do. She can’t stop laughing. A repeat of game 6 of the Stanley Cup is on Ten Sports India. I watch it, getting psyched for Game 7. I check online for Ten Sports schedule. Game 7 will be on at 5:30am! I can’t miss that! Set my alarm. Try to sleep. Can’t sleep. Try to sleep. Can’t sleep. Try with TV on. Can’t sleep. Try with TV off. Can’t sleep. Finally fall asleep… Alarm!

Day 3a: Penguins win the Stanley Cup!

Really hard to wake up at 5:30am. Actually maybe not quite as hard since it’s 8pm in my head. Game on! Nerves are racked up. Can’t sit down: bad luck. Pacing. No score first period. Tons of commercials, all for Ten Sports programming: wrestling, cricket, tennis. Every commercial repeats three times. Is period two coming? Yes, it’s back on! Pens score first! Fist pumping and muted cheering. Can they really do this? No sitting rule in full effect. Pacing. Pens score again! Talbot second goal. Wow, is this real? Can it be? Don’t think about it yet. Don’t celebrate to soon. Plenty of time left. Period two end at 2-0. Unbelievable. All the same commercials come back, three times each. Period three begins. Stand up. Pace. Clock ticks. Pens are playing too defensive: not taking shots, just throwing the puck out of their zone. This isn’t good. Detroit is getting tons of chances. Fleury is awesome. Five minutes left. I let myself think about winning the cup. Mistake! Detroit scores! It’s 2-1! Nerves are ratcheted up beyond ratcheting. I think about it all slipping away. How awful that would feel. If Detroit ties it up, imagine the let down, the blown opportunity. Clock ticks. More chances. More saves. More defense. It’s working! Detroit pulls their goalie. Pressure. Final seconds. Faceoff in our zone. Detroit wins control. Shot. Rebound. Right to a Red Wing — Nick Lidstrom — in perfect position. He shoots. Fleury swings around. He saves it! It’s over! Pens win the Cup! Super fist pumping, jumping around, dancing, muted cheering. They did it! How amazing it feels after last year’s loss to the same team. After falling behind 2-0 and 3-2 in the series. They came back! A delicious payback with the same but opposite script as last year: a two goal lead cut in half in the waning minutes, a flurry of attempts at the end including a few-inch miss of the tying goal in the last seconds. These guys are young and have the potential to rule hockey for several years if they’re lucky. Mario Lemieux is on the ice. How sweet. Twice as player, now as owner, the one who saved hockey in Pittsburgh. What a year for Pittsburgh sports! Two nail biter games, two comebacks, two championships. City of Champions again. Too bad the Pirates have no shot to join them in a trifecta. Back to sleep.

Day 3b: Sightseeing

Phone rings at 11am — my driver is here. Off to do some whirlwind sightseeing. Everyone here who finds out I have a day off recommends I leave Bangalore — Bangalore is just not that nice, nothing really to see, they say. They all recommend Mysore, 3.5 hours away, but that is too far for my comfort level given that my flight is late tonight and it’s supposed to thunderstorm. We start with some souvenir shopping on “MG Road”. My driver takes me to a store and waits in the car outside. I walk in an instantly there are people greeting me and showing me things. One aggressive man takes over and remains my “tour guide” through the whole store. The fact that I reward his aggressiveness by following along and eventually buying stuff will only bolster him to do more of the same in the future. Annoying but clearly it works. I do negotiate him down, but I leave still feeling I didn’t bargain hard enough and with a bit of distaste in my mouth that I fueled and validated the pushy tactics. Next we drive past parliament and the courthouse. Impressive, large, old buildings. But I can just gaze and take photos from the car — can’t go inside. Next we drive past Cubbon Park — tree lined paths and flower gardens in center city. Next is ISKCON temple. But it’s closed. So one more round of shopping at a place called Cottage Industries. I’m wary given the last experience, but go anyway. This one is better. Again one person escorts me around but I feel less pressure. Plus I’m more prepared to say no and negotiate harder. I leave with what seems like a fair amount of value in goods. I recommend Cottage Industries to future visitors: more professional, more familiar (items have price tags), lower pressure, greater variety, and higher quality than at least the first shop I visited. Now we’ve killed enough time and the ISKCON temple is open. It’s a giant Hare Krishna temple. The parking lot is full. I tell the driver it’s ok — we don’t need to go. He says “you go, you go”. “Ok” I say. We drive around again to the same full parking lot. The attendant waves at us to leave, blowing a whistle. My driver is talking to him. They are talking quite heatedly. The attendant in his official looking uniform is waving us on vigorously. Although I can’t understand the words, he is clearly telling us the lot is full and we must leave immediately — we are holding up traffic. My driver is getting more insistent. They are yelling back and forth. I have no idea what he says but it works. The guard let’s us in. Meanwhile another car sees our success and tries to argue his way in too but to no avail. I ask my driver what he said: he simply replies “don’t talk”. Indeed once we’re in, there is an empty spot. We put all my bags in my suitcase in the trunk and cover my backpack. We take off our shoes and my driver leads me to the temple. He knows the back entrance and is guiding me to cut in front of lines everywhere. We walk past the main attraction: the altar with some people on the floor worshiping. Then the line weaves past a gift shop of course: I buy a crazy looking book (Easy Journey to Other Planets). We need to kill some time. We go to the gardens again to walk around. We walk into the public library. Most books are in English. Most seem old and worn. The attendant says the library is 110 years old. We start walking through the garden but I am paranoid about mosquitoes/malaria so we turn around early to return to the car. We go to UB City where I meet Rajeev. It’s a thoroughly modern office tower half owned by Kingfisher of Kingfisher Airlines. The building is full of high-end shopping like almost any upscale western mall with all the same brands. Here is the Apple Store. Here is Louis Vuitton. We have dinner at an Italian restaurant that could be anywhere in the western world, owned by an Italian expat. The only seating is outside and I remain worried about mosquitoes but don’t see any. The food is good and the conversation is good.

This place is the closest I’ve seen of the future of Bangalore. In the center of town, a gorgeous building filled with gleaming shops and tantalizing restaurants and bars, with apartments and condos within walking distance, and a palm-tree-lined street leading to the central town circle and the park. As Rajeev says, though, whereas New York has hundreds of similar scenes, Bangalore has one. For now.


Thoughts on Bangalore

Bangalore is a city of jarring contradictions, a hard-to-fathom mix of modernity and poverty. Signs with professional logos and familiar brands are set askew on dilapidated shacks and garages lining the road. While many live on dollars and day and others beg, the majority are smartly dressed (men invariably in button-down shirts), have mobile phones, and are intelligent and friendly. There are gleaming office towers indistinguishable from their western counterparts, yet a strong rain can flood the roads to the point of become impassible for hours and day-long blackouts aren’t uncommon. Many billboards are in English, sporting familiar brands and messages. Others, like sexy stars promoting a Bollywood film, are entirely familiar, English or not. Others are impenetrable. Still another advertises a phone number to learn why Obama quoted the Koran.

BMWs and Toyotas join bikes, motorcycles, pedestrians, aging trucks and buses, and colorful open-air motorized rickshaws in a sea of disorganized line-ignoring sign-ignoring traffic. People drive here the way New Yorkers walk sidewalks: weaving past one another in a noisy self-organized tangle that somehow — mostly — works. You can eat outside in a restaurant bar next to upscale shops, a fountain, and smiling yuppies, yet worry that a malaria-infected mosquito lurks nearby or that a washed vegetable will turn a western-coddled stomach deathly ill. When two people ride a motorcycle, as is common, only the driver wears a helmet — the passenger clinging on behind does not: new and old rules on display atop a single vehicle. And the traffic. Oh, the traffic. Roads are clogged nearly every hour of every day. My Saturday of sightseeing was as bad or worse than weekday rush hour. The extent of congestion itself illustrates Bangalore’s two faces: so many people with youth (India is one of the youngest countries in the world), energy, purpose, and the means and intelligence to accomplish it overtaxing a primitive infrastructure. Buildings are going up according to western specs, but under old-time rules where corruption reins and bribery is an accepted fact of life by even the western-educated aspirational class (about 20% and growing, according to Rajeev).

Thoughts on Yahoo! Labs Bangalore

The folks I met are impressive. Rajeev has done a great job hiring talented, driven folks. Mani‘s group of research engineers is fantastic. One is headed to Berkeley for grad school and asks great questions about CentMail. Another proposes an attack on Pictcha. Another (Rahul Agrawal) has read up deeply on prediction markets, including Hanson’s LMSR.

Thoughts on the Yahoo! Big Thinkers India program

The whole event was organized to precision. Anita, the PR lead, was incredible. I especially appreciated the extra “above and beyond” touches like having someone pick up Yahoo! India schwag for my family and send it to my hotel after I forgot: so nice. Raghu, who arranged the media interviews, is supremely organized and on top of his game. The fact that the event draws such a large crowd shows that there is great thirst for events like this in Bangalore. I’m not sure whose idea it is, but it’s a brilliant one: great marketing and great for recruiting.

Thank you Bangalore

In sum, thanks to the people of Bangalore for a fascinating and rewarding trip. Thanks to Rahul at the travel desk whose instant replies about the driver arrangements calmed my nerves on the stressful day of my departure. Thanks to the Yahoo! folks who arranged and organized my talk, and the Yahoo! Labs members for seeding an exceptional science organization. Thanks to my driver who got me everywhere — including into full parking lots, back entrances, and fronts of lines — with efficiency, safety, and a smile (when I tipped him, I tried to think wwsd and wwdd: what would Sharad or Dan do?). Thanks to those who attending my talk and whom I met afterward: it’s gratifying and invigorating to see your level of interest and enthusiasm (and your numbers). And thanks Bangalore chefs for keeping any stomach upset relatively mild and brief.

At the airport on the way out, the flight is overbooked and they are offering close to US$1000 plus hotel to leave tomorrow. Not a chance. It’s been fun and an adventure but my nerves are on high and I miss my family: it’s time to make the 20+ hour journey home.

An (old) essay on new media

I wrote an essay on “new media” for an entrepreneur friend in February 2004. (My friend launched a new air sports league and .tv channel, hence the emphasis on sports near the end.) I decided to take my own advice and relinquish control. Here it is, with minor re-touches marked and links added. Most of the points remain applicable in 2009. If anything, I’m a little disappointed that, five years later, we haven’t made more progress toward “everything over IP, everywhere”. Sure, Hulu is nice but I still pay obscene amounts to send text messages and watch The Terminator over proprietary pipes.


‘Digital’ means everything and nothing at once. And that’s the point. Music is digital. Movies are digital. Books, news, commentary, communication, ideas, and sexuality are all digital. Even money is digital. Characterizing something as digital conveys no information precisely because most anything can and will be digital. From television to telecom, from Hollywood to Madison Avenue, the transition to digital will take down giants and crown new kings.

Why does digital matter to media? There are three reasons: convergence, copying, and control.

Convergence. Because all content and communication are digital, the delivery mechanism no longer matters. You don’t need a TV to watch television programs. You don’t need a phone to talk to a friend. You don’t need a fax to get faxes or a CD player to hear CDs. All you need is a machine that understands digital and a communications system that carries digital. Today’s best devices for understanding and communicating digital are, respectively, the computer and the Internet. That’s all you need. Tomorrow’s TVs may look and feel and act much like today’s TVs, but rest assured they will be computers in disguise, and they will be connected to the Internet. There’s no inherent reason why Friends should be watched on Thursdays at 8pm on NBC interspersed with commercials. It can, should, and will be watched at the viewer’s leisure, uninterrupted. There is no reason that the biggest “television” phenomenon of 2008 won’t be seen on Yahoo!, for example. [In hindsight, this example was wildly optimistic — and YouTube/2020 now seems more likely — though in 2008 viewers flocked to Yahoo! for the Olympics, the election, and short-form video.] Notions of channels and schedules will be virtually meaningless. We already see this happening with DVRs like TiVo, and the blurring will continue with computer/TVs providing access to movies, music, your photo album, weather, news, and the Web. Cable, phone, and satellite companies are providing Internet access. Internet portals and Internet providers are delivering phone calls, movies, TV shows, [radio,] and email all over the same wires [and wavelengths].

There is now, and will continue to be, fierce opposition to convergence from established players. Cable companies objected vehemently to allowing local stations onto satellite TV. Broadcast networks fear TiVo. The Recording Industry Association of America (RIAA) is in a state of panic panicked, suing everyone in sight, including their own customers. Lobbying and lawmaking will slow convergence, but the changes are all but inevitable. While the RIAA and groups like it scramble to rearrange deck chairs on the Titanic, opportunists are busy building entirely new ships.

Copying and Control. Once a piece of media content—whether it is a song, a movie, or an article in a scientific journal—is converted into digital ones and zeros, it can be copied (perfectly) and distributed at almost zero cost. Given the decentralized nature of the Internet and the vagaries of international law, once a piece of content escapes there is almost no reining it in. Current media business models rely on tight controls. Control of scheduling. Control of delivery and distribution. Control of store shelves. Control of artists and content creators. Control of consumers’ attention. But digital content resists nearly all attempts at control. Software and hardware copy-protection schemes are hacked or circumvented. High-quality analog copies of digital content are simply impossible to stop. Artists can self-publish their work and distribute it worldwide. Consumers can suddenly find content that’s not broadcast at primetime or placed at eye level in the store.

Note that digital does not mean the end of marketing, influence, and celebrity. Capturing the public’s interest and attention are still necessary. A self-published song does not magically attract listeners. Talent, personality, advertising, branding, and social forces will still play large roles in driving media success in the digital era. But convergence means that any number of players can provide the marketing and distribution needed, breaking current oligopolies, and almost certainly benefiting artists and consumers alike. Successful business models for the next generation of media companies must address the loss of control on all three fronts: content, artists, and consumers. Content will be copied. Artists will self-publish and shop for marketing services. Consumers will view what they want when they want to.

The New Business of New Media

Media is certainly not dead. Certain aspects will probably never change. People yearn for good stories, for entertainment, for escapism, for information. People flock to charisma and celebrity. People communicate insatiably. From a business perspective, there is undeniable value in having and holding the attention of a number of people.

Although the face of tomorrow’s media is impossible to predict, certain sectors are poised to benefit enormously from the emergence of digital, or are at least less susceptible to its problems.

Here are some winning strategies:

Embrace convergence. Convergence offers almost limitless flexibility in delivering and customizing content. Sports fans can watch an event from any camera, watch real-time animated renderings allowing absolute viewer control, interact with video games with parallel story lines, or chat with other fans. News broadcasts can allow viewers to examine any topic to any depth. Toys can react to signals embedded in Saturday morning cartoons. Consumers can create customized “channels” delivering content tailored to their needs and whims. Companies that capture the voicexyz-over-Internet market will be big winners in the new-media world.

Embrace copying. There is no doubt that a large part of the business value of media lies in its ability to influence (usually via advertising), which in turn benefits most from widespread adoption. For a business built on influence, free and unfettered copying should be encouraged rather than litigated. Not everything has to be free. In some cases, people will pay to get content faster. Live events are the most obvious situation where copies are less valuable than originals. People may pay for live feeds of sporting events, for example. In many cases, people will pay for higher-quality content, for example higher-resolution movies or better-sounding music. For example, with a good digital rights management system, pristine digital copies might be sold for a small premium, even while slightly tarnished analog copies (which are essentially unstoppable) proliferate. People may pay a premium for convenience, anonymity, quality assurance, or to obtain versions stripped of commercial messages. Clearly delineated commercials are a problem in a world where time shifting and copying are prevalent: people will simply skip commercials. So commercial messages must be embedded directly in the content, using product placement or endorsements.

Real-time gambling offers a natural source of revenue for sporting events and other live events. Real-time gambling is spreading quickly throughout the UK and Europe, where it is well regulated and taxed. Real-time gambling offers a situation where live feeds are essential, and copies less damaging. In fact, wide dissemination of copies could be valuable as a marketing device to drive interest in the live events and concurrent gambling services.

Bem+Wom happens: The ALL-ETT wallet anecdote



pocket
mousetrap

Ernie told me about it. Sid and I told Lance who blogged it. Bill Gasarch read it, bought it, loved it, and blogged it again.

And so it goes for ALL-ETT, the ultimate wallet. Bem+Wom: BEtter Mousetrap + Word Of Mouth. It actually works.

It works for Google too:

[Google’s] growth has come not through TV ad campaigns, but through word of mouth from one satisfied user to another

And now, a viral restaurant.

But, beyond anecdote, continuing from the previous post, is this sort of thing worth $15 billion?

Companies with Bem benefit hugely from Wom and will happily pay for it.

And social networks are nothing if not mouths exchanging words, so it’s natural to think of some paid version of Bem+Wom as their killer app. Facebook Beacon is an innovative attempt despite the overblown backlash.

Paying mouths for words is affiliate marketing, a respectable if not Google-sized business. But turning friends (or celebrities) into salespeople induces a threshold of skepticism, as it should. Paid mouths’ faces must be awfully trustworthy, their words especially persuasive to be believed. Is it even “word of mouth” anymore?

Can Bem+Wom be monetized without mucking it up?

The social advertising puzzle

There’s no doubt that social ties have tremendous value: people find love and work largely through the people they know and the people the people they know know.

And there’s no doubt that digital representations of social ties add value. Facebook does improve people’s lives.1

The puzzle, and one of the key challenges facing companies like Facebook, Google, and Yahoo!., is how social media can make money. So far the evidence is most users won’t pay directly, which leaves ideas like virtual goods, community marketplaces, app stores, and, of course, advertising. Unfortunately, although we know great ways to advertise to people searching, and decent ways to advertise to people viewing content, it’s less clear how to advertise to people communicating.

P&G’s Ted McConnell puts it bluntly:

What in heaven’s name made you think you could monetize the real estate in which somebody is breaking up with their girlfriend?

Riffing off of this quote, Wired asks the $15 billion question: Is social advertising an oxymoron?:

So, what if social media and advertising just don’t mix?

SocialMedia.com, a social advertising startup, begs to differ (hat tip to Cong Yu), reacting to the same provocative McConnell quote. Their answer:

Advertisers only pay when users volunteer to say something about the brand to their friends.

Indeed, this sort of paid version of Bem+Wom (“BEtter Mousetrap + Word Of Mouth”) — more on this in the next post — is one of the first things people think of when pondering how to monetize a social network. But can it work well and if so, how?


Three disjoint friends like Rooster Sauce. Who knew?

1For example, I never would have guessed that three completely disjoint friends of mine are all fans of Sriracha Rooster Sauce. Who knew?