All the information you need in one place

How Nelio A/B Testing decides on a winning variant?

A winning variant in Nelio A/B Testing is the variant which is most likely to perform better than the original version of your element under test (a page, a widget, a menu, …).

Nelio A/B Testing uses the G-test statistic for computing the results of a test. The G-test statistic is a measure of how much overall variant there is from an ideal prediction that you would expect if all versions were the same.

At what confidence do we need to end the test? There is no hard rule, however a common benchmark is 95% confidence. By default, Nelio A/B Testing decides that there is a statistically significant winning variant, when the confidence level we get from the G-test statistic reaches 95%.