A/B Testing: Can you iterate your way to great products?

Jeff Atwood’s (@codinghorror) blog about the movie “Groundhog Day” got me thinking much more deeply about A/B testing, a powerful tool in a set of tools that enable a new generation of nimble startups to compete effectively against the big Internet players.

For example, Match.com is stuck on a decade-old architecture and would be hard-pressed to create dozens of unique traffic funnels and ruthlessly tune them to extract optimal performance from each acquisition channel. Hence, the window is open for new competitors who can use these tools to develop products from the get-go.

But what are the limits of iterative optimization?

Split testing is, in my view, no substitute for product vision.

Human beings are probably the ultimate result of great product development through split testing – evolution is one giant iterative experiment. Unfortunately for Internet startups it took millions of years … Read More »




From the Blog

Box, Uber and 29-cent Tacos

My twitter is alive today with stories of Box, now offering *unlimited* file storage for just $35.  What a deal!  Consumers love...

What’s the Big Idea?

“To me, ideas are worth nothing unless executed. They are just a multiplier. Execution is worth millions.” — Steve Jobs

Conventional wisdom in...

The Power of Preference

Uber is getting a lot of attention for the eye-popping price of their lastest financing round ($17B, in case you missed it).  It’s amazing...