Course Content
The Art of A/B Testing
The Art of A/B Testing
1. What is A/B testing?
Shapiro Test
The Shapiro Test is a statistical test that is used to test the hypothesis of a normal distribution. It compares the distribution of the data with a normal distribution.
The null hypothesis assumes that the data are normally distributed. If the p-value is below the significance level (below 0.05), then the null hypothesis is rejected.
In such a case, we can argue that the data is not normally distributed (the alternative hypothesis is accepted).
Let's run the Shapiro Test for the first columns from the control and test groups at the same time:
Great! We got two results.
The higher the Statistic value, the more evidence is found in favor of a normal distribution. The p-value in both groups is high (greater than 0.05), which means we accept the null hypothesis.
Both columns are normally distributed.
Note
If we have more than 5 000 observations, it is better to use the Kolmogorov-Smirnov test. Its use is similar to the Shapiro test.
Everything was clear?