A/B testing
Why use A/B Testing? A/B testing helps merchants evaluate the effectiveness of their campaigns by testing different gift or discount variations under the same condition. This allows you to understand
Applicable Campaign Types
A/B testing is available for the following campaign types:
- Gift with cart value
- BXGY (Buy X Get Y)
What can be tested?
With A/B testing, you can test the gift or discount customers receive under the same spending condition.
Goals:
- Understand customer preferences when spending the same amount of money.
- Compare the effectiveness of different reward types (discounts vs. free gifts) in driving conversion, AOV, and additional value.
Use Cases:
- Spend $50 → Option A: 10% off socks vs. Option B: 10% off t-shirt
- Spend $50 → Option A: free clock vs. Option B: free glasses
Setup
- Create or edit a campaign (Gift with cart value or BXGY).
- Inside the campaign editor, enable A/B test.
- This will allow you to configure Option A and Option B rewards under the same condition.
- Define the reward for each option (discount or free gift).
- Save and activate the campaign.
Customers will be randomly assigned to either Option A or Option B when they meet the campaign condition.
Analytics
In the campaign list, you can track performance for each option within the A/B test:
- Views: Number of times the offer was shown.
- ATCs (Add to Carts): Number of times customers added the gift/discount.
- CR (Conversion Rate): How effectively the offer converts views into actions.
- Revenue / Additional Value: Contribution of each option to your store’s revenue.
By comparing Option A and Option B results, you can identify which reward drives better performance and optimize future campaigns accordingly.
