How to Create a Popup Test

Popup Tests let you compare different versions of a popup on your website to find out which one drives more conversions.

You can test design, timing, triggers, calls-to-action, or even entire messaging strategies — all directly from your WordPress dashboard. Whether you use Elementor Popups or Nelio Popups, you can now A/B test them with precision and ease.

Step 1: Create a New Popup Test

1. In your WordPress dashboard, go to Nelio A/B Testing → Tests.
2. Click Add Test.
3. In the dialog, select Popups (under the “Global” or test types list).

💡 Popup Tests are compatible with:

• Elementor Popups
• Nelio Popups Other popular popup builders may be supported in future releases — reach out to our team if you’d like to see your preferred plugin integrated!

Step 2: Name and Define Your Test

Give your test a descriptive name (for example, “Newsletter Popup – CTA Test” or “Exit Intent Discount Popup”).

In the right sidebar, you’ll find:

• Status & Management: track whether your test is Draft, Ready, Scheduled, or Paused, and define start/end dates.
• Description: describe your hypothesis (e.g., “We believe showing a popup after 10 seconds increases signups compared to exit-intent popups”).
• Note: The popup test only applies to the set of content that shows the popup under test.

Step 3: Choose Control and Variants to Test

Choose the popup (depending on you setup, either you published Elementor Popups or your active Nelio Popups) you want to use as your Control Version (A).

Add New Variants

1. Create one or more variants (Version B, C…) of the popup.
2. Select alternative popups from the list of options available in your WordPress installation.
3. Give each variant a descriptive name — for instance, Variant B – Different CTA” or “Variant C – New Trigger.”

Step 4: Define Goals and Conversion Actions

Every test needs a goal — what counts as success.

Each goal can include one or more conversion actions that describe the specific behavior you want to track.

Name your goals, then click the Add Action button to choose from the available conversion actions.

You can combine multiple actions under one goal.

🔍 Learn more: What Are the Conversion Actions and Goals? →

Step 5: Add Segmentation Rules (Optional)

Segmentation lets you decide who participates in the test. You can target visitors by conditions such as:

URL parameter · Referrer · Language · Location · Logged-in status · Visitor Type · Day/time · Browser · Device type · Operating system · Window Width · Cookie · IP address

If you skip segmentation, all visitors to the tested pages are included automatically.

🔍 Learn more What is Segmentation and How to Use It →

Step 6: Start the Test

When everything is ready:

1. Review your setup summary at the top of the page.
2. Click Start.

Nelio A/B Testing will:

• Randomly assign visitors to variants.
• Track conversions anonymously via Nelio Cloud.
• Display real-time results in your dashboard.

⏯ Pause, Resume, or Stop Your Test

• Pause a running test if you need to make changes, then resume it later.
• Stop a test manually whenever you want, or let it end automatically under certain conditions such as duration, total number of visits or confidence results (available in Professional and Enterprise plans).
• Once a test is stopped, its results remain available for review.

Step 7: View Results and Analyze Performance

While your test runs, go to Nelio A/B Testing → Tests and click View Results to monitor its progress.

Summary of the results

In the right sidebar, you’ll find a quick overview of your test:

Goal selector – Choose which goal’s results to display.

Status icon – Indicates experiment status:

🟡 Collecting data.

🕒💛 Potential winner, low confidence

🟢🏅 Clear winner found.

🔴 No improvement over control.

Unique results – Filter duplicates.

Public results – Share a public link.

Export results – Download a CSV.

Summary – Shows status, duration, start date, and end condition.

Test Progress

The main area of the results page is divided into two tabs that visualize your test’s progress and performance:

• Conversion Rates — A line chart showing conversion evolution across variants.
• Views and Conversions — Compares total visits and conversions for each variant.

Confidence indicators appear alongside these charts, updating automatically as more data accumulates.

Below the charts, you’ll find a summary table with:

• A thumbnail preview (if available) of each variant.
• Number of visits and conversions.
• Conversion rate and improvement over control.

Step 8: Improve Your Web Conversion

You can end a test manually using the Stop button in the upper-right corner of the results page, or let it end automatically based on the configured end mode.

After completing a test, review the results to identify the winning popup. Then, manually assign that popup to the relevant pages or posts in WordPress to apply your learnings and improve your website’s conversion rate.