Hello, just wondering which testing method is used to calculate statistical significance for the A/B test feature. Frequentist vs Bayesian vs Sequential? Any other details regarding calculations are performed or formulae used?
Thanks for posting on our Community forum and for your patience.
The method used depends on the metrics and the data. There is a selection of TTest, ChiSquare, and MannWhitneyU used in our A/B Testing plugin.
I trust this answers your question.
Thanks Richard. Could you provide more details regarding the selection criteria that determines which method is used?