A/B testing: Conversion rate reported based on visits (ideally it should be visitor or option to switch)

Hi,

In the AB test report, the conversion rate is currently calculated based on visits. In many cases, however, this is not the best approach, and a visitor-based view would be more appropriate.

Would it be possible to extend the report so users can choose whether the conversion rate should be calculated based on visits or visitors?

Ideally, it would also be helpful if conversions could be viewed as either unique conversions or all conversions. The reason is that, for example, when running a cashier test, looking only at all conversions can produce very skewed results depending on where the more active users end up.

To reduce this β€œwhale” impact, we usually need to look first at unique conversions β€” meaning whether a user placed an order or not β€” and then, as a second step, look at orders per user.

Many thanks for considering this request.

Best regards,
Sejla

1 Like