You've probably heard that split testing elements of your website can improve your conversion rates. And that's true. But there are many kinds of split testing out there. And there are many ways to set up split tests on your website.

There are many differences among the split testing software options on the market today. Let me give you a brief taxonomy of the subject matter.

The first main division is between simple split testing (single variable) and multivariate testing.

Simple split testing is easy. You're just "trying stuff" one thing at a time. You want to try a different headline? Split test it. When that test finishes, you want to "try" something else? Split test that. You can test one alternative version or many. As long as it's a single element of your page you're testing, that's simple split testing. All you need is a tool that rotates the different versions of the headline (or whatever) on your page, and keeps track of which one produces the most sales.

Paul Hancox has a simple split testing tool. And Google has one that's free, though it takes a bit to set up all your accounts to use Google's tool. And the reporting is not real-time.

With multivariate testing, you can test many factors at the same time on your page. So, instead of just testing your headline, you can test your headline, your offer, the P.S. statement, and your lead image all at the same time. And with multivariate testing, if it's set up right, you can use the same amount of traffic testing many variables that you would use to test a single variable.

So there's the main distinction between single variable testing and multivariate testing. But once you get into the realm of multivariate testing the options seem to multiply again. One difference among multivariate tools is between tools that are hosted on someone else's server, and ones that you install on the same server as your webpages. Hosted solutions can be slower, and more expensive, but you don't have to install any software.

Hosted solutions include Google's Website Optimizer, and Vertster. Installed solutions include the Split Test Accelerator and Kaizen Track.

The next distinction probably causes the most confusion among people looking into split testing for the first time. It's also more important than the last distinction, becuase it determines how fast and accurate your tests can be. The three kinds of testers are 1) random independent rotators, 2) Taguchi testers, and 3) full-factorial testers. Taguchi ranks first for speed and second for accuracy. Basically Taguchi testing involves using a marvel of mathematics known as "orthogonal arrays". These have special properties that allow you to test every combination in a space while running only a small fraction of the actual combinations. You have to be a little bit careful about interaction effects with Taguchi testing. The Split Test Accelerator and Kaizentrack are Taguchi testing tools.

If you want to get around interaction effects you can with a full factorial tool. It will take more traffic to avoid the interactions -- a lot more -- but with a FFT, like Google's Website Optimizer, you can just see how every combination plays out, and live with the interactions.

The Random independent rotators are a third option. These treat factors independently. So you can just plug in a new factor with as many options as you want at any time, and ignore the fact that other factors are being tested at the same time. This is the most flexible form of testing, but it is also plagued with the most interaction effects.

Now that's just the overview. There are many other features to compare and questions to ask. Does a tester allow you to exclude bots and spiders? Does it allow real time access to data? What kind of reports does it show? What kind of information does it track for each visitor, and is the visitor-level data available for viewing. Etc.

Internet Marketing Products on our marketplace

Dominic DeLong has used split testing software for years to improve web sites.