A/B Testing: Can you iterate your way to great products?

Jeff Atwood’s (@codinghorror) blog about the movie “Groundhog Day” got me thinking much more deeply about A/B testing, a powerful tool in a set of tools that enable a new generation of nimble startups to compete effectively against the big Internet players.

For example, Match.com is stuck on a decade-old architecture and would be hard-pressed to create dozens of unique traffic funnels and ruthlessly tune them to extract optimal performance from each acquisition channel. Hence, the window is open for new competitors who can use these tools to develop products from the get-go.

But what are the limits of iterative optimization?

Split testing is, in my view, no substitute for product vision.

Human beings are probably the ultimate result of great product development through split testing – evolution is one giant iterative experiment. Unfortunately for Internet startups it took millions of years … Read More »




From the Blog

Consolidating AppleID (itunes ID), MobileMe ID, and iCloud ID

As regular readers will know, I’ve switched back to iOS from Android with some mixed feelings.  However, I am excited about Yosemite and the...

A Startup CEO’s Guide to Burn Rates and Vaporization

 

The alarm has sounded.  A three-alarm fire, with alarms named Bill, Fred and Marc.  Burn rates are too high, change course or risk the...

What I Miss About Android

I switched to Android a year ago.  An experiment, I suppose. I was also (maybe unreasonably) offended by the iPhone 5S which seemed like...