Introduction
A/B Testing enables you to maintain the best results between mailings based on a single criterion at a time, from among :
- Email subject
- Email sender
- Email content
With generalization, a defined percentage of the target group receives the winning version of the A/B test.
Carry out an A/B Test with generalization
To activate this option, simply go to the Schedule tab and select the With generalization option.
The percentage selected corresponds to the number of people in the target group who will be targeted by the different test versions. The people targeted by the winning version are identified and put on hold until the generalization is sent.
Finally, in the Winning version settings section :
- Dispatch of the winning version will begin x hours after the end of dispatch of the A/B test versions. This delay is defined during programming. The longer the time, the closer the result is to reality, as this gives recipients time to interact. In general, a minimum delay of 24 hours is recommended.
- The use of the winning version is based on KPIs (Key Performance Indicators). These are performance indicators. By default, two KPIs are provided:
- Open rate
- Click rate
Custom KPIs (e.g. conversion rate) can be added on request to the Numberly team.
Conclusion
By activating the With generalization option, the campaign will be broadcast in two stages
- A/B Test, initially on a volume corresponding to the selected percentage.
- generalization to the rest of the target in a second phase
Campaign results by version are visible from Dashboardly.