Which testing method is used to calculate stat sig in A/B testing?

Premium Features
1

Hello, just wondering which testing method is used to calculate statistical significance for the A/B test feature. Frequentist vs Bayesian vs Sequential? Any other details regarding calculations are performed or formulae used?

2

Hi @Veenay_Sehdev
Thanks for posting on our Community forum and for your patience.

The method used depends on the metrics and the data. There is a selection of TTest, ChiSquare, and MannWhitneyU used in our A/B Testing plugin.

I trust this answers your question.

3

Thanks Richard. Could you provide more details regarding the selection criteria that determines which method is used?