Documentation

All the information you need in one place

What is the meaning of the confidence value you provide together with the results? How to interpret it?

The confidence value tells you how “trustable” is the fact that one variant is better than the other/s.

A high confidence value tells you that you can be certain that choosing the best variant is the best option to improve your conversion rate. A low confidence value means that with the current results, even if one variant has so far a higher conversion rate than another, this could still be due to random effects so you have to interpret the results with caution.

We recommend waiting for at least a 90% confidence value in order to be sure to choose the best variant.

The more visitors you have and the bigger is the observed difference between the variants, the higher will be the confidence value.