The Overview tab of a campaign displays the main information and enables you to see straight away whether or not the campaign is ready for analysis. It shows two levels of information:
- The progress level of your test campaign, which enables you to know whether or not it is ready for analysis;
- Summary information regarding the criteria defined during steps 1,2, 4, 5 and 6 of the campaign configuration process.
Not only does the Overview tab enable you to track your campaign progress, it also lets you make sure the creation steps have been configured correctly.
For more on the mobile application, refer to The AB Tasty mobile application.
Accessing the Overview tab
To access the Overview tab of an A/B test, apply the following steps:
- Go to the campaign dashboard and click an A/B test:
The Overview tab is displayed.
So far, the Overview tab is only available for A/B tests.
Overview and progress level of the campaign
The top section of the screen displays the following information:
- the name of the A/B test;
- the ID of the A/B test;
- the technical status (Live or Paused);
Use the button at the bottom of the screen to start or pause the test.
Campaign progress level card
The Campaign progress card indicates whether or not the A/B test is ready for analysis. It features the three following criteria: the traffic for the test as a whole (Traffic), the conversion rate on the main goal (Conversions) and the test duration (Time).
The card displays the progress level of traffic and duration indicators. The color varies depending on progress levels:
- Less than 33% - Red/orange
The test is far from being ready for analysis. The data collected so far is insufficient.
- Between 34% and 99% - Yellow/orange
The test isn't ready for analysis yet. The data collected so far isn’t sufficient enough to guarantee reliable results.
- 100% - Green/blue
The test is ready for analysis because all three criteria have been met.
The Traffic section displays the number of unique visitors who have seen the test, as well as the number of visitors yet to be reached.
In order for campaign results to be reliable, it is preferable to wait until you have reached at least 5,000 unique visitors per variation.
The Conversion section displays the number of conversions on the main goal as well as the number of conversions needed.
In order for campaign results to be reliable, it is preferable to wait until you have reached at least 500 conversions per variation on the primary goal.
The Traffic section displays the number of days since test creation, as well as the number of days to go.
We recommend waiting at least 15 days before viewing the test results.
By default, the test creation date is displayed. You can change the test start date if you ran the QA process or if you didn't launch it immediately after creating it.
To do this, apply the following steps:
- Click the icon .
- Select a date on the calendar.
- Click OK:
The date is updated.
Summary of the criteria
The last section of information is a summary of the criteria set up during steps 1 (main information), 2 (variation editor), 4 (targeting), 5 (traffic allocation) and 6 (3rd party integration) of campaign configuration and combines the following sections:
- the Campaign details section;
- the URL targeted section;
- the Audience section;
- the Traffic allocation section;
- the 3rd party integration section.
Campaign details section
The Campaign details section displays the following information:
- the number of variations;
- the A/B test creation date;
- the creator of the A/B test;
- the original hypothesis of the A/B test.
URL targeted section
The URL targeted section displays the URL of the page(s) on which the changes made via the variation editor will be visible to your visitors.
The green dot indicates that the URL(s) specified in the platform will be included. The red dot, on the other hand, indicates that the URL(s) is/are excluded.
If no target page was defined during step 4, the URL configured during step 1 (main information) is displayed by default.
The Audience section displays the targeting criteria, i.e. the categories of visitors who will see the changes made to your test.
The following information is displayed:
- the audience name (in the case of a custom saved audience, which is therefore reusable);
- the type of operator selected (AND and/or OR);
- the list of the various targeting criteria defined.
If no audience was defined, all the users who visit the pages defined as target pages will see the test.
Traffic allocation section
The Traffic allocation section displays the breakdown of traffic between the original version and the variation(s), as well as the percentage of non-tracked visitors.
3rd party integration section
The 3rd party integration section displays the name(s) of the tool(s) that have been enabled for this test.
If no 3rd party tools were enabled for this test, nothing is displayed.
The information displayed in the Overview tab cannot be modified via the mobile application. To make changes to one or more of the displayed fields, you need to change the campaign configuration via the AB Tasty web platform.
Mobile application - Goals tab