What Test Results Does Nelio A/B Testing Show?

Nelio A/B Testing’s Results page gives you a complete view of how your test is performing, from its current statistical status to the performance of each variant and how results have evolved over time.

You can open the Results page directly from the Overview or from the Tests page by selecting the test whose results you want to analyze.

Statistical Status

At the top of the Results page, Nelio summarizes the current statistical status of the test for the selected conversion goal.

Depending on the data collected so far, Nelio may indicate that:

• there isn’t enough data yet to evaluate the variants reliably;
• no variant is clearly outperforming the control;
• a variant appears to be performing better but more evidence is needed; or
• a clear winner has been identified.

The summary also shows the current confidence and the Typical Sample Size, which provides an indicative range of the amount of data a test may typically need before reliable conclusions can be drawn.

As your test collects more data, this information is updated automatically.

🔍 Learn more: How Does Nelio A/B Testing Decide on a Winning Variant?

Control Version and Variants

The Control Version and Variants section lets you compare the performance of all the alternatives included in the test.

For each variant, you can see metrics such as:

• Unique Page Views;
• Unique Conversions;
• Conversion Rate; and
• Improvement compared with the control.

If Nelio has identified a winner, the winning variant is also clearly highlighted in this section.

When heatmap data is available, you can also open the Heatmap for a variant directly from this section.

This gives you a quick comparison of the overall performance of each alternative before exploring how those results have evolved over time.

Conversion Goals and Actions

The Conversion Goals and Actions section shows what the test is actually measuring.

If your test has multiple conversion goals, you can review the actions associated with each one, such as visiting a particular page, clicking an element, completing a purchase, or triggering another configured conversion action.

Select a conversion goal to review its configuration and use the Goal selector in the Results sidebar to display the results associated with that goal.

Performance Analysis

The Performance Analysis section lets you explore how the test results have evolved over time.

You can switch between two views:

• Conversion Rates – Shows how the conversion rate of each variant evolves over time.
• Views and Conversions – Shows the evolution of page views and conversions for the variants.

You can also aggregate the chart data by day, week, or month, which can make trends easier to identify depending on how long the test has been running and the level of detail you want to analyze.

Below the evolution chart, Nelio provides additional comparisons showing:

• the overall Conversion Rate of each variant; and
• the Improvement of each alternative compared with the control.

These charts make it easier to compare the current results while also understanding how stable—or volatile—the observed differences have been over time.

Results Sidebar

The Results panel in the right sidebar provides additional controls for analyzing and sharing your results.

Depending on the test, you may find:

• Goal – Select which conversion goal you want to analyze.
• Unique results – Remove duplicate events from the displayed results.
• Public results – Enable a public version of the results that you can share with others.
• Export Results – Export your test results for further analysis.

The Summary section also provides additional information about the test when available.

The same Results page is available while a test is running and after it has finished. While the test is active, the statistical status and charts continue to update as new data is collected.

Understanding the Results

The Results page combines two complementary perspectives.

The statistical status tells you whether the data collected so far provides enough evidence to draw a conclusion, while the variant metrics and Performance Analysis help you understand how each alternative is performing and how that performance has evolved.

Avoid choosing a winner based solely on which variant currently has the highest conversion rate. A difference between variants may still be the result of random variation, especially when the test has collected little data.

🔍 Learn more: Why Do I Need a Minimum Number of Visits to Compute the Results? How Many Visits Are Required?