Nelio A/B Testing includes multiple types of tests, and (usually) you can run them all at the same time. Thus, for instance, you can run two page tests on two different pages at the same time, you can run a headline test and a CSS test, and so on. However, we implemented a couple of limitations that you should be aware of:
- You cannot run multiple tests on the same element at the same time. Thus, for instance, you cannot run two test on the landing page at the same time, or you cannot run two theme tests at the same time. If you think about it, that makes complete sense: if you’re testing your WordPress’ front page with two different tests, and a user lands on that page, which alternative should be shown?
- You cannot run tests affecting the same scope at the same time. Some tests include the possibility of declaring a set of pages where they run. For the sake of simplicity, we decided that you can only run one test at a time on a given URL. Why? Well, think about a theme test and a widget test affecting the same pages. Each alternative theme might define its own (alternative) menus or widgets, and have its own CSS rules… It doesn’t make sense to run them all at the same time, doesn’t it?
A side note on running multiple tests…
Running multiple tests all at once entails some complexities you should be aware of. For instance, if you have two different tests running and a conversion occurs, which test gets credit for it? Does one test affect the other? In our blog, you’ll find a very detailed post that addresses all these issues.