Automatic A/B testing

A/B testing is now easier than ever.

Start by creating a new email/SMS/push notification/Viber campaign. There you will find AB testing and click on it.

The settings window will open

First set the number of contacts you want to test. Let's say if you set 100 customers. The system then creates two testing groups of 50 customers.

Choose the sending time of the AB testing which influences how long the AB testing lasts. Choose at least 1 day before the campaign begins. But the ideal is at least 2-3 days. On the day of the campaign the system ends the testing and automatically sends the more successful template to the rest of the customers.

Now it's time to choose the two campaign templates you want to test. The template needs to be done first in the Email designer. It is recommended to test one change at a time. For instance, if you want to test which subject line fits better - for template A write a short subject line and for template B write a long subject line. Another great example is discount. Choose a 30% percentage discount in template A and 50 EUR discount for template B to see what your customer will like more.

Lastly, choose the metric you want to measure success of the campaign.
Open rate: The percentage of email recipients who opened the email out of the total number delivered.
Click through rate: The percentage of recipients who clicked on a link within the email out of the total number of emails delivered.
Click to open total: The total number of unique clicks in an email divided by the number of unique opens.
Click to open rate: The percentage of recipients who clicked on a link after opening the email.
Purchase conversion: The percentage of users who completed a purchase after receiving the email.
Uplift total: The overall increase in revenue across all channels by customers receiving the email.
UTM Revenue: The revenue generated from clicks tracked through UTM parameters in the email, counting only the purchases made immediately after the click from email.