A/B Testing: Can you iterate your way to great products?

Jeff Atwood’s (@codinghorror) blog about the movie “Groundhog Day” got me thinking much more deeply about A/B testing, a powerful tool in a set of tools that enable a new generation of nimble startups to compete effectively against the big Internet players.

For example, Match.com is stuck on a decade-old architecture and would be hard-pressed to create dozens of unique traffic funnels and ruthlessly tune them to extract optimal performance from each acquisition channel. Hence, the window is open for new competitors who can use these tools to develop products from the get-go.

But what are the limits of iterative optimization?

Split testing is, in my view, no substitute for product vision.

Human beings are probably the ultimate result of great product development through split testing – evolution is one giant iterative experiment. Unfortunately for Internet startups it took millions of years … Read More »




From the Blog

Questions about the Apple Car and a Controversial Approach

 

 

Like the vast majority of people who like nice things, I love Apple products for their great design.  I am a car guy generally, and...

Consolidating AppleID (itunes ID), MobileMe ID, and iCloud ID

As regular readers will know, I’ve switched back to iOS from Android with some mixed feelings.  However, I am excited about Yosemite and the...

A Startup CEO’s Guide to Burn Rates and Vaporization

 

The alarm has sounded.  A three-alarm fire, with alarms named Bill, Fred and Marc.  Burn rates are too high, change course or risk the...