Customizing the User Interface

The User Interface settings let you customize how Nelio A/B Testing presents test results and guides you through the plugin.

These settings don’t affect how your tests run or how data is collected. They only influence the information displayed in the WordPress dashboard.

For most websites, the default values are recommended.

Required Sample Size

The Required Sample Size determines the minimum number of tested page views a test should collect before Nelio A/B Testing considers its results reliable enough to highlight a potential winner.

Larger sample sizes generally produce more reliable conclusions but require more traffic before a winner can be identified. Smaller sample sizes allow results to appear sooner, although they’re more susceptible to random fluctuations.

💡 Recommendation: We recommend a minimum sample size of 500 tested page views for most tests.

⚠️ Note: This setting only affects when Nelio highlights potential winners in the user interface. It doesn’t stop tests from collecting data or prevent you from reviewing their results.

Required Confidence

The Required Confidence defines the statistical confidence level a test must reach before Nelio A/B Testing highlights a winning variant. Higher confidence levels provide greater certainty that the observed differences are real rather than due to random chance.

For example:

• 90% identifies winners sooner but with less certainty.
• 95% offers a good balance between confidence and test duration.
• 99% requires more data but provides stronger statistical evidence.

💡 Recommendation: A confidence level of 95% is appropriate for most tests.

⚠️ Note: This setting affects how results are presented in the interface. You can still inspect the complete test data regardless of the selected confidence level.

Show Plugin Tutorials Automatically

Nelio A/B Testing includes interactive tutorials that introduce the main features of the plugin. When this option is enabled, tutorials are automatically displayed the first time you visit certain areas of the interface.

If you prefer to explore the plugin on your own, you can disable automatic tutorials. They remain available and can be launched manually at any time.

💡 Recommendation: Leave this option enabled if you’re new to Nelio A/B Testing.

Recommended Configuration

For most websites, we recommend: