I have created an A/B test and have been running the test for a few days, but have found the report produced difficult to interpret. I have tried reading the documentation, but am none the wiser. Here is what I understand the report to be telling me, but would appreciate validation that I have understood the report correctly.
As background, we are using matomo to track a site. I have created an AB test and added the script to some of the pages on the site, not all of which meet the target pages filter.
Here is what I understand the report to be telling me.
Evolution over the period: This is showing the number of pages that included the AB testing script. The script is only included on some of the pages on the site, but not all of them. This is different to the number of pages included in the test as the script is included on pages that are not part of the target pages.
In the overview report I have the following columns:
Visits - this is showing the number of visits to pages that included the AB testing script, not the number of visits to the site in general.
Visit actively entered - this is showing the number of pages that met the conditions of the target pages filter.
Unique Visitors - this is showing the number of unique visitors that visited pages that met the conditions of the target pages filter.
Of the success metrics they have the following meaning.
Average Pageviews: This is the number of pages viewed across the whole site and not just those that have the AB testing script included.
Bounce Rate: this is the percentage of users that viewed the page meeting the target pages filter and then did not view any more pages on the site.
Average time on website: This is the average time the user spent on the whole site and not just the time spent on the pages with the AB testing script installed.
Any help much appreciated.