Category Archives: blogging

Woblomo: A post more postmortem

Whew. Woblomo is over. At the last minute, I changed my goal from posting every day to every other day, and I couldn’t be happier. Sixteen posts in thirty one days is challenge enough.

First, I actually failed my own challenge. If I had stickKed it, I’d be stuck with a bill. I missed the March 9 deadline by 5 hours and 3 minutes. I woke up on March 10 in a hotel room with the sudden horrible realization that I “was fail”. I quickly published a post, ending with a quip suggesting that according to Hawaii Standard Time I had a full 53 minutes to spare. Even though every other day comes every other day (for most people an easily recognizable pattern) I somehow simply forgot. I did end up meeting the other fifteen deadlines according to my actual time zone. There’s always next year.

The exercise was absolutely worthwhile for me. I published several posts that were idling in my idea file, where I’m sure they’d remain if it weren’t for the impetus of forced deadlines. As of today, quantcast says my traffic has gone from 700 to 1,900 people per month, my site ranking from the high millions to 686,628. Google Reader says I have 416 subscribers and impressively clocks my posts/week at precisely 3.5.



quantcast-oddhead-traffic-graph

I also rushed a few wonder bread posts toward the end. Dear reader: on balance do you think my blog was better during this version of March Madness?

Money Conciousness — one of four other bloggers who participated in woblomo as far as I can tell — says “I don’t think I will ever do this again in the future”. I definitely plan to. I believe it was nearly the perfect length and pace: just enough to serve as a prod to clean out the “easy” posts from my queue and force a few wingits, without leaving me completely bankrupt. I wouldn’t want to keep up the pace every month, but I could easily see doing it twice a year instead of once.

The meme “woblomo” has reached 9,430 places around the web, including the The Monthly Newsletter of the Lansing Junior Chamber of Commerce. Not exactly “wisdom of crowds” fame, but not bad.

My favorite quote about woblomo was from Anthony Towns:

Via David Pennock, who is apparently of the view that if something’s worth doing, it’s worth registering the domain and turning it into a worldwide phenomenon. And hey, why not?

Apparently so. Just wait until I get around to explaining freeralph.com.

An (old) essay on new media

I wrote an essay on “new media” for an entrepreneur friend in February 2004. (My friend launched a new air sports league and .tv channel, hence the emphasis on sports near the end.) I decided to take my own advice and relinquish control. Here it is, with minor re-touches marked and links added. Most of the points remain applicable in 2009. If anything, I’m a little disappointed that, five years later, we haven’t made more progress toward “everything over IP, everywhere”. Sure, Hulu is nice but I still pay obscene amounts to send text messages and watch The Terminator over proprietary pipes.


‘Digital’ means everything and nothing at once. And that’s the point. Music is digital. Movies are digital. Books, news, commentary, communication, ideas, and sexuality are all digital. Even money is digital. Characterizing something as digital conveys no information precisely because most anything can and will be digital. From television to telecom, from Hollywood to Madison Avenue, the transition to digital will take down giants and crown new kings.

Why does digital matter to media? There are three reasons: convergence, copying, and control.

Convergence. Because all content and communication are digital, the delivery mechanism no longer matters. You don’t need a TV to watch television programs. You don’t need a phone to talk to a friend. You don’t need a fax to get faxes or a CD player to hear CDs. All you need is a machine that understands digital and a communications system that carries digital. Today’s best devices for understanding and communicating digital are, respectively, the computer and the Internet. That’s all you need. Tomorrow’s TVs may look and feel and act much like today’s TVs, but rest assured they will be computers in disguise, and they will be connected to the Internet. There’s no inherent reason why Friends should be watched on Thursdays at 8pm on NBC interspersed with commercials. It can, should, and will be watched at the viewer’s leisure, uninterrupted. There is no reason that the biggest “television” phenomenon of 2008 won’t be seen on Yahoo!, for example. [In hindsight, this example was wildly optimistic — and YouTube/2020 now seems more likely — though in 2008 viewers flocked to Yahoo! for the Olympics, the election, and short-form video.] Notions of channels and schedules will be virtually meaningless. We already see this happening with DVRs like TiVo, and the blurring will continue with computer/TVs providing access to movies, music, your photo album, weather, news, and the Web. Cable, phone, and satellite companies are providing Internet access. Internet portals and Internet providers are delivering phone calls, movies, TV shows, [radio,] and email all over the same wires [and wavelengths].

There is now, and will continue to be, fierce opposition to convergence from established players. Cable companies objected vehemently to allowing local stations onto satellite TV. Broadcast networks fear TiVo. The Recording Industry Association of America (RIAA) is in a state of panic panicked, suing everyone in sight, including their own customers. Lobbying and lawmaking will slow convergence, but the changes are all but inevitable. While the RIAA and groups like it scramble to rearrange deck chairs on the Titanic, opportunists are busy building entirely new ships.

Copying and Control. Once a piece of media content—whether it is a song, a movie, or an article in a scientific journal—is converted into digital ones and zeros, it can be copied (perfectly) and distributed at almost zero cost. Given the decentralized nature of the Internet and the vagaries of international law, once a piece of content escapes there is almost no reining it in. Current media business models rely on tight controls. Control of scheduling. Control of delivery and distribution. Control of store shelves. Control of artists and content creators. Control of consumers’ attention. But digital content resists nearly all attempts at control. Software and hardware copy-protection schemes are hacked or circumvented. High-quality analog copies of digital content are simply impossible to stop. Artists can self-publish their work and distribute it worldwide. Consumers can suddenly find content that’s not broadcast at primetime or placed at eye level in the store.

Note that digital does not mean the end of marketing, influence, and celebrity. Capturing the public’s interest and attention are still necessary. A self-published song does not magically attract listeners. Talent, personality, advertising, branding, and social forces will still play large roles in driving media success in the digital era. But convergence means that any number of players can provide the marketing and distribution needed, breaking current oligopolies, and almost certainly benefiting artists and consumers alike. Successful business models for the next generation of media companies must address the loss of control on all three fronts: content, artists, and consumers. Content will be copied. Artists will self-publish and shop for marketing services. Consumers will view what they want when they want to.

The New Business of New Media

Media is certainly not dead. Certain aspects will probably never change. People yearn for good stories, for entertainment, for escapism, for information. People flock to charisma and celebrity. People communicate insatiably. From a business perspective, there is undeniable value in having and holding the attention of a number of people.

Although the face of tomorrow’s media is impossible to predict, certain sectors are poised to benefit enormously from the emergence of digital, or are at least less susceptible to its problems.

Here are some winning strategies:

Embrace convergence. Convergence offers almost limitless flexibility in delivering and customizing content. Sports fans can watch an event from any camera, watch real-time animated renderings allowing absolute viewer control, interact with video games with parallel story lines, or chat with other fans. News broadcasts can allow viewers to examine any topic to any depth. Toys can react to signals embedded in Saturday morning cartoons. Consumers can create customized “channels” delivering content tailored to their needs and whims. Companies that capture the voicexyz-over-Internet market will be big winners in the new-media world.

Embrace copying. There is no doubt that a large part of the business value of media lies in its ability to influence (usually via advertising), which in turn benefits most from widespread adoption. For a business built on influence, free and unfettered copying should be encouraged rather than litigated. Not everything has to be free. In some cases, people will pay to get content faster. Live events are the most obvious situation where copies are less valuable than originals. People may pay for live feeds of sporting events, for example. In many cases, people will pay for higher-quality content, for example higher-resolution movies or better-sounding music. For example, with a good digital rights management system, pristine digital copies might be sold for a small premium, even while slightly tarnished analog copies (which are essentially unstoppable) proliferate. People may pay a premium for convenience, anonymity, quality assurance, or to obtain versions stripped of commercial messages. Clearly delineated commercials are a problem in a world where time shifting and copying are prevalent: people will simply skip commercials. So commercial messages must be embedded directly in the content, using product placement or endorsements.

Real-time gambling offers a natural source of revenue for sporting events and other live events. Real-time gambling is spreading quickly throughout the UK and Europe, where it is well regulated and taxed. Real-time gambling offers a situation where live feeds are essential, and copies less damaging. In fact, wide dissemination of copies could be valuable as a marketing device to drive interest in the live events and concurrent gambling services.

Data-driven Dukie

“The No-Stats All-Star” is an entertaining, fascinating, and — warning — extremely long article by Michael Lewis in the New York Times Magazine on Shane Battier, a National Basketball Association player and Duke alumni whose intellectual and data-driven play fits perfectly into the Houston Rockets’s new emphasis on statistical modeling.

For Battier, every action is a numbers game, an attempt to maximize the probability of a good outcome. Any single outcome, good or bad, cannot be judged in isolation, as much as human nature desires it. Actions and outcomes have to be evaluated in aggregate.

Michael Lewis is a fantastic writer. Battier is an impressive player and an impressive person. Houston is not the first and certainly not the last sports team to turn to data as the arbiter of truth. This approach is destined to spread throughout industry and life, mostly because it’s right. (Yes, even for choosing shades of blue.)

Pricing the cloud, circa 1968

This article (membership required) is remarkable mostly for the fact that it was published in 1968. (Hat tip to Jonathan Smith.) It describes an experiment in creating an artificial economy to buy and sell computer time in the cloud, an idea that has been kicked around a number of times in the intervening decades but never quite took hold, until recently if you count literal pricing in dollars in EC2. The concept of buying time on your company’s compute cluster in a pseudo currency may come back into vogue as such installations become commonplace and over demanded.

Also check out the hand drawn figure and the advertisement at the end:


COBOL extensions to handle  data bases

A tale of two insurance/prediction markets

Chris Masse has the scoop (once again proving how indispensable he is) on a new real-money prediction market coming soon, one of the few with the CTFC’s blessing to operate in the United States: The American Civics Exchange. Their tag line focuses on the insurance angle: “Your greatest financial risks may be hiding in plain sight — market-based solutions for political risk management”.

Meanwhile, Carlos Saieh, a sharp student in Justin Wolfers’ class where I just gave a guest lecture, found an apparent pricing bug in another insurance-oriented prediction market, WeatherBill (proving how indispensable attentive students with laptops and wifi are):



WeatherBill pricing mistake


Let’s see: for a mere $770, you can purchase a contract that pays out at most $700 in the absolute best case, possibly much less. Hmm, let me think about that one.

Finally, a financial contract that makes mortgage-backed securities look good.

Remembering greasemonkey

As part of an internal hack day I’ve been diving back into greasemonkey, and remembering how much the monkey mentality changes the way you think about the web. Greasemonkey seems to have lost some mindshare momentum, probably due to a natural hype/fatigue cycle, the still minority share of Firefox browsers, and the very real “laziness barrier” that keeps the vast majority of people from installing new stuff.

In any case, rediscovering how easy it is to muck with any and every website, usually for fun, and sometimes to truly improve usability or productivity, brings back the giddy avalanche of ideas of ways to “reclaim the web”.

For example, it wouldn’t be terribly hard to add a bit of xmlhttpRequest to WebVocab to create a shortcut that, with one click, inserts a custom signature into any comment you leave on any web page, at the same time notifying your favorite social feed service (e.g., friendfeed, Facebook, Yahoo! updates) and/or your own server of the comment location and content. Your friends see where and what you’re commenting, and you get a searchable archive of all the breadcrumbs you leave around the web. It’s like a comment aggregator service that users control rather than publishers, and thus that works on any website, putting the user back into user-generated content.

The long tail of science: Good, bad, or ugly?

(First in a series of “random thoughts on science”)

A mind boggling number of academic research conferences and workshops take place every year. Each fills a thick proceedings with publications, some containing hundreds of papers. High-profile conferences can attract five times that many submissions, often of low average quality. Smaller venues can seem absurdly specialized (unless it happens to be your specialty). Every year, new venues emerge. Once established, rarely do they “retire” (there is still an ACM Special Interest Group on the Ada programming language, in addition to a SIG on programming languages). It’s impossible for all or even most of the papers published in a given year to be impactful. Most of them, including plenty of my own, will never be cited or even read by more than the authors and reviewers.

No one can deny that incredible breakthroughs emerge from the scientific process — from Einstein to Shannon to Turing to von Neumann — but scientific output seems to have a (very) long tail.

Is this a good thing, a bad thing, or just a thing?

Is the tail…

Good?
Is the tail actually crucial to the scientific process? Are some breakthroughs the result of ideas that percolate through long chains — person to person, paper to paper — from the bottom up? Is science less dwarfs standing on the shoulders of giants than giants standing on the shoulders of dwarfs? I published a fairly straightforward paper that applies results in social choice theory to collaborative filtering. Then a smarter scientist wrote a better paper on a more widely applicable subject, apparently partially inspired by our approach. Could such virtuous chains actually lead, eventually, to the truly revolutionary discoveries? Is the tail wagging the dog?
Bad?
Are the papers in the tail a waste of time, energy, and taxpayer dollars? Do they have virtually no impact, at least compared to their cost? Should we try hard to find objective measures that identify good science and good scientists and target our funding to them, starving out the rest?
Ugly?
Is the tail simply a messy but necessary byproduct (I can’t resist: a “messessity”) of the scientific process? Under this scenario, breakthroughs are fundamentally rare and unpredictable hits among an enormous sea of misses. To get more and better breakthroughs, we need more people trying and mostly failing — more monkeys at typewriters trying to bang out Shakespeare. Every social system, indeed almost every natural system, has a long tail. Maybe it’s simply unavoidable, even if it isn’t pretty. Was the dog simply born with its (long and scraggly) tail attached?

Jamesburg, New Jersey: Per-capita bank branch capital of the world

By 2007, Jamesburg, New Jersey, a town of 6,000, had four walk-in bank branches — Bank of America, Constitution, PNC, and Sovereign — complete with bricks, mortar, tellers, and aura of trust along its quaint “Main Street” downtown corridor.

Apparently that wasn’t enough.

In 2008, Chase Bank and TD Bank broke ground. Thousands of motorists now pass them every weekday morning on their way to the New Jersey Turnpike and again every evening on their way home. If I had a hand in it, I might insert a drive-thru restaurant, of which there are currently none, into the path of commuters. But I don’t and the Invisible Hand chose otherwise: to erect two more banks for a total of six banks within one square mile, or one for every 1000 residents. (To be fair, the surrounding township has 30,000 people, but probably a dozen more banks.)


Six walk-in bank branches within one square mile in Jamesburg, NJ USA

We live in an era of electronic banking when ATMs dispensing paper money seems horribly analog. Walking through a door under a roof of a building representing the shelter for my money to talk to a person is, I’ll admit, occasionally reassuring, and even less occasionally useful. But everyone must admit that this is an activity growing rarer by the day.

So why are bank branches staging a last stand in this small New Jersey town?

Probably because the surrounding community, Monroe Township, is home to several retirement communities whose residents select banks based on the accessibility of branches. (They also buy newspapers and watch ABC’s World News with Charles Gibson at 6:30 and hence commercials for prescription drugs.)

Several new shopping centers have gone up in the area and each seems to have the same collection of stores, anchored by a drug store and a bank.

The data may say that these are profitable investments, but for how long?

Jamesburg would seem to have great potential as a consumer destination: a walkable urban strip in the center of a relatively affluent suburban township, on the bank of a gorgeous lake adjacent to a 675 acre park. Yet it has a few mom and pop shops, one Subway, one Dunkin’ Donuts, and one gas station. And six banks. Go figure.

KISS prediction markets (lingo) goodbye

The lingo of prediction markets varies widely.

The same “thing” might be called an information market, idea future, virtual stock market, financial market, securities market, event market, binary option, betting exchange, bookmaker, market in uncertainty, or gambling/wagering. Only recently has the name prediction market emerged with some sort of consensus.

To place a prediction in the market, you might do any of the following:

[bid/buy/bet on/back] the “yes” [security/contract/coupon/future/outcome] at [price/probability/fractional odds/decimal odds/moneyline] X

Predicting something won’t happen gets even uglier. You might:

[ask/short sell yes/buy no/buy bundle & sell yes/bet against/lay] at [price/probability/fractional odds/decimal odds/moneyline] X

For example, InklingMarkets uses the “short sell yes” variation:

InklingMarkets' explanation of short selling

So what is the clearest language for prediction markets?

A good guiding principle in this regard is KISS: Keep It Simple Stupid. Or, in more grandiose terms, Occam’s razor. All else being equal, one should choose the simplest and most straightforward option.

By this measure, it seems that betting lingo wins hands down. It’s vastly simpler to say “I bet $10 that Obama will lose” than to say “I short sell three shares of Obama at price 67”. The former is more direct and intuitive. Almost everyone understands what it means to place a bet, including subtleties like risk, uncertainty, and competition. On the other hand, even avid stock traders get tripped up by the concept of selling short.

Every prediction can be stated as: “I bet that outcome O will/won’t happen; I’ll risk $X to win $Y”. Betting for things and against things is symmetric. There is no need to short sell, buy bundles first, etc.

Yet most prediction markets don’t KISS, going with financial terminology instead, reflected even in the name itself. Why? I believe it’s because of the legal and social stigma attached to gambling. It’s a shame that such considerations force vendors to make the technology harder to understand and more complicated to use.

A world without roads and wires

Take the Earth and subtract just two things: roads and wires. How much more pleasant a place would it be? No asphalt arteries carving a dense grid throughout the world’s grass and trees devouring tax dollars. No endless rows of poles and towers draped with miles and miles of wires coming between our eyes and our skies. Imagine the makeover the space around and under your desk would receive!

Actually, the vision may not be as far fetched as it seems: we just need personal flying vehicles and wireless power & communications.