Fight Club Promo Image

The first rule of A/B testing is “You don’t talk about A/B Testing“. You probably saw this one coming but it perfectly applies here. As soon as your visitors are aware they are part of a split or multivariate test, the test loses all its validity since visitors may change their behaviour. This is a basic rule but, surprisingly, many companies violate it by making public one way or the other the fact they are A/B testing their site (even sometimes going to the extreme of asking their visitors to try to see the different alternatives and say which one they prefer).

Luca Sartoni collects this and other basic A/B testing rules in a “Fight Club style” in his post: The Rules of A/B Testing by Tyler Durden. Most of them are common sense but you know that common sense is the less common of all senses so better to take a look!

And once you’re done, go ahead and complement your dosis of A/B Testing common sense by watching this recent presentation by Ton Wesseling:

Keynote Digital Data Tips Tuesday – Amsterdam – June 24th 2014 – A/B-testing analytics errors from Online Dialogue

 

Hope you found them useful and please share with us your best A/B testing practices! Are they similar to the suggestions above? Why (or why not)?

Leave a Reply

Your email address will not be published. Required fields are marked *

I have read and agree to the Nelio Software Privacy Policy

Your personal data will be located on SiteGround and will be treated by Nelio Software with the sole purpose of publishing this comment here. The legitimation is carried out through your express consent. Contact us to access, rectify, limit, or delete your data.

Person writing a new WordPress post on a MacBook

Looking for popups?

We have the best plugin to create popups for WordPress in minutes.

Request Customized Enterprise Pricing

10
200000

With your express consent, we handle the information provided for the purpose of contacting you and until you ask us to delete it.

70% OF YOUR VISITORS DO EXACTLY WHAT
YOU JUST DID AND NEVER COME BACK!

KEEP THEM
ON YOUR SITE
LONGER WITH
NELIO POPUPS

Claim Your Discount Now

Image with a 10%-off coupon

WAIT! BEFORE YOU GO...

Get this awesome discount now!

No, I don't want to save money

Image with a 10%-off coupon

WAIT! BEFORE YOU GO...

Get this awesome discount now!

No, I don't want to save money

YOUR COOKIE SETTINGS


This site uses proprietary operational cookies that have a purely functional purpose and third-party cookies that help us understand how visitors interact with the site by collecting and presenting information anonymously. To get more information about these cookies and the processing of your personal data, check our Privacy & Cookie Policy. Do you accept these cookies and the processing of personal data involved?


If you don’t, you can reject non-operational cookies and continue browsing this site by clicking here.