A/B Testing

Test different offer variations to find what converts best. A/B testing lets you compare up to 2 options for each upsell step and measure which performs better.

How it works

When A/B testing is enabled, customers are randomly shown one of the test variations. The app tracks performance metrics for each variation so you can identify the winner.

What you can test

You can create variations for any of these elements:

Element
Description

Offer title

Test different headlines and messaging

Discount type & value

Compare percentage vs fixed amount, or different discount levels

Template

Test different layout designs

Countdown display

Test with/without countdown timer

Countdown text

Test different urgency messages

Expiration time

Test different offer durations

Free shipping

Test with/without free shipping offer

Product layout

Test scrollable vs standard layout

Metrics tracked per variation

  • Impressions — number of times the variation was shown

  • Total Orders — number of orders created from this variation

  • Total Revenue — revenue generated by this variation

Setting up an A/B test

Step 1: Open your offer

Navigate to your offer's edit page. In the upsell step you want to test (Upsell #1, Upsell #2, or Downsell), look for the A/B Test toggle.

Step 2: Enable A/B testing

Turn on the A/B test toggle. This creates Option A (your current settings) and Option B (a new variation).

Step 3: Configure Option B

Modify the settings for Option B. For example:

  • Change the discount from 10% to 15%

  • Use a different template

  • Adjust the countdown timer text

Step 4: Save and monitor

Save your offer. The app will automatically split traffic between the two options and track performance.

Step 5: Review results

Check the A/B test results in your offer's analytics. Compare:

  • Which option gets more orders?

  • Which generates more revenue?

  • Which has a higher conversion rate?

Step 6: Pick a winner

Once you have enough data, stop the A/B test and keep the winning variation. Click Stop A/B test to save the results and apply the winner.

Best practices

  • Run tests long enough — wait for at least 100 impressions per variation before drawing conclusions

  • Test one element at a time — changing multiple things makes it hard to know what caused the difference

  • Start with high-impact elements — test discount value and offer title first, as they have the biggest impact on conversions

  • Reset analytics if you make changes mid-test to get clean data

Availability

A/B testing is available for all upsell steps:

  • Post-purchase upsell: Upsell #1, Upsell #2, and Downsell

  • Thank you page upsell: Upsell step

  • Order status page upsell: Upsell step

Last updated