What is A/B testing?

Welcome to the A/B testing course. In this section, we will tell you what controlled experiments are, where they are used, and why they are used. We will look at a specific example of a controlled experiment and talk about A/A testing. The Python programming language will help us with this. Well, let's get started!

Normality Check

Before conducting a controlled experiment, we need to determine the characteristics of the sample. The type of tests that we will conduct a little later will depend on these characteristics. You will learn to build distribution histograms, box plots, and check the normality of the distribution. Let's get started right now!

Variances in A/B Testing

The last thing to do before conducting a controlled experiment is to check the sampling variances. Some types of graphs and Levene's test will help us with this. Let's talk about it in more detail in this section!

T-Test

So we got to A/B testing. Soon you will make your first parametric tests, or as they are also called - T-tests. We'll use all the knowledge we've learned in the previous sections: metric definition, normality testing, variance testing, and plotting. All this will help us get statistically significant results. Well, to work!

U-Test

It turns out that sometimes the samples do not have a normal distribution. This means that we cannot perform parametric testing. What to do in such a situation? Non-parametric testing. We will talk about him in the last section.