Documentation

All the information you need in one place

How long should I run a test?

The duration for which you need to run your A/B testing tests depends on several factors such as follows:

  • The complexity of the test. The more complex the test (more variants, with less differences between them, …), the longer you will need to run the test to get significant results.
  • The number of visitors who participate in the test. The more number of people you test, higher is the reliability of the test results.

Stopping a test too early may result in not getting meaningful results, while keeping a test running for too long could make you lose conversions and sales due to poor performing variant in the test.

We’ve investigated the amount of time the test of our customers have been running. In average, all the test were running for less than a month and most of them didn’t surpass two weeks. In our opinion, that’s not too much time regarding the benefits you can get in return! Also, if you fail to find a winning combination within this amount of time, you may conclude that the variants do not stand a chance to beat the original version.

Person writing a new WordPress post on a MacBook

Looking for popups?

We have the best plugin to create popups for WordPress in minutes.

Request Customized Enterprise Pricing

10
200000

With your express consent, we handle the information provided for the purpose of contacting you and until you ask us to delete it.

70% OF YOUR VISITORS DO EXACTLY WHAT
YOU JUST DID AND NEVER COME BACK!

KEEP THEM
ON YOUR SITE
LONGER WITH
NELIO POPUPS

Claim Your Discount Now

Image with a 10%-off coupon

WAIT! BEFORE YOU GO...

Get this awesome discount now!

No, I don't want to save money

Image with a 10%-off coupon

WAIT! BEFORE YOU GO...

Get this awesome discount now!

No, I don't want to save money

YOUR COOKIE SETTINGS


This site uses proprietary operational cookies that have a purely functional purpose and third-party cookies that help us understand how visitors interact with the site by collecting and presenting information anonymously. To get more information about these cookies and the processing of your personal data, check our Privacy & Cookie Policy. Do you accept these cookies and the processing of personal data involved?


If you don’t, you can reject non-operational cookies and continue browsing this site by clicking here.