π Definition
The goal of reporting is mainly to facilitate the analysis of your campaign results and to ensure that the conclusions you draw are safe from a statistical point of view.
Readiness is an indicator which lets you know when your campaign or goal has reached statistical reliability and is therefore ready to be analyzed.
Readiness is available in the reporting of both your test and personalization campaigns.
βοΈ Functioning
Readiness is available for:
- Each goal you have selected for your campaign (goal readiness): readiness is based on the 3 following metrics:
Campaign duration (days)
The campaign must be live for at least 14 days.
Traffic volumetry (visitors)
At least 5,000 unique visitors must see each variation.
Number of conversions
At least 300 unique conversions must take place on each variation on the primary goal.
We recommend waiting for each goal to be ready before analyzing their results. - The whole campaign (campaign readiness): readiness is based on the campaignβs primary goal performance. When the primary goal is ready, meaning that it has reached the required number of days, conversions and visitors, the campaign is considered ready as well and reliable. We recommend waiting for your campaign to be ready before analyzing its results.
β Good to know
For browsing metrics (Revisit rate, Pages per session and Bounce rate), the conversion metric is not taken into account in readiness calculation, meaning that goal readiness is based on days and the number of unique visitors only.
Readiness statuses
There are 4 readiness statuses, which enable you to know whether or not the campaign is ready for analysis at a glance.
π What you see |
π Status |
π Explanation |
No data |
No data |
Your campaign and/or goal hasnβt collected any data yet, is in QA or has never been launched. |
Ready |
Ready to be analyzed |
Your campaign and/or goal is statistically reliable. That is to say it has been live for more than 14 days, had enough visitors and conversions on the primary goal. |
Not ready |
Not ready to give reliable results yet |
Your campaign and/or goal is not statistically reliable yet. Either because there have not been enough visitors and/or conversions, or because your campaign has been live for less than 14 days. We recommend waiting before analyzing the results of your campaign. |
π© Heads up
If you change the traffic allocation of your campaign after it has been launched, campaign and goal readiness will automatically adapt.
π© Heads up
Variations that have less than 1% of the traffic wonβt be taken into account in the readiness calculation.
Filtered data
When filtering your reporting data, the readiness of the filtered data is displayed in addition to the goal readiness, to let you know if the reporting data are also ready to be analyzed.
Calculation is the same and based on campaign duration, traffic volumetry and number of conversions.
Once these criteria have been reached, the readiness of the filtered data turns blue, meaning that filtered data is ready to be analyzed. You will also see a blue-striped banner at the left of the Unique visitors card to inform that filters have been applied to the reporting.
β Good to know
Readiness of the filtered data may take more time to be reached as the number of visitors meeting the filtered criteria is lower. For example, if you filter your reporting data on mobile visitors, readiness wonβt be reached until at least 5,000 unique visitors have seen each variation.
For more information, refer to Analyzing a filtered reporting.
Need additional information?
Submit your request at product.feedback@abtasty.com
Always happy to help!
Comments
0 comments
Please sign in to leave a comment.