How much improvement in conversions can I expect?

Conversion improvements depend on a lot of factors: amount of visitors you get, number of variants under test, differences between the…

What is the meaning of the confidence value you provide together with the results? How to interpret it?

The confidence value tells you how “trustable” is the fact that one variant is better than the other/s. A high confidence value tells you…

How long should I run a test?

The duration for which you need to run your A/B testing tests depends on several factors such as follows: The complexity of the…

How Nelio A/B Testing decides on a winning variant?

A winning variant in Nelio A/B Testing is the variant which is most likely to perform better than the original version of your element…

Why do I need a minimum number of visits to compute the results? How many visits is the minimum?

With a very low number of visits, you could not trust the results since they can be just due to pure chance. Imagine that only two people…

Differences in data collected from Nelio A/B Testing and Google Analytics

Nelio A/B Testing and Google Analytics have different tracking methods, which means you may find differences in the number of visitors…

How does Nelio A/B Testing calculate statistical significance?

Nelio A/B Testing uses the G-test statistic for computing the statistical significance of the results of a test. The G-test…

Using email notifications

Nelio A/B Testing might send some email notifications when certain events occur. You can specify if you want to be notified when an…

How do I know the status of my tests?

You can easily know the status of your running tests by looking at the overview page of Nelio A/B Testing: Each A/B test has a circle in…

How can I download Nelio A/B Testing’s graph reports?

You can download the charts and graphs that are displayed in the results of a test and create your own reports using them. Just right click…