Download this episode

Knowing what works on your website is critical. Here are some tools to help you find evidence of what works best.

Geek Tool

• 02:15 – Gorillapod - Flexible camera tripod

Webapps

• 04:47 – Posterous – Create a place for your “stuff” with only an email.
  • Tip from Ryan Heimbuch
• 08:33 - FollowBase – Listing of companies that provide support via twitter

Topic

• 11:26 – Evidence Based Web Development
  • Split (A/B) Testing
  • Tools
    • Google Website Optimizer
    • PHP Script
    • Django plugin for split testing
  • Tests to get you started
    • Headline
    • Sub-headline
    • Opening paragraph
    • Call to action
    • Submit buttons
    • Colors
    • Check similar sites in your industry and try similar elements
  • Knowing when you are finished
    • If the result of page A was 20 conversions, and the result of page B was 30 conversions, then the difference between the two is 10.
    • The sum of the two results is 50
    • The square root of that sum is 7 (rounded down)
    • The difference (10) is greater than the square root of the sum (7), so the result is statistically significant.
  • Companies that primarily use split testing
    • Amazon.com
    • Google
    • Intuit
    • Microsoft
    • Ebay
    • Yahoo
  • Analysis of Amazons add to cart button over the years
  • Top Google designer shows criticism of the amount of engineering Google puts into its designs