Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Learn Control and Test Groups | The First A/B Test
A/B Testing in Python
course content

Course Content

A/B Testing in Python

A/B Testing in Python

1. What is A/B Test?
A/B Test and our GoalMetrics and HypothesisHow Not to Fail a Test
2. The First A/B Test
Data StudyWhat Criterion to ChooseCriterionControl and Test GroupsPlots to CompareIntervals to CompareNow We Can AnswerTo Sum Up
3. Performing One More AB Test
Data StudyPreparationPreprocessing DataChoosing the CriterionCriterionDividing into GroupsComparing GroupsWhat to Do with the ButtonPink or Blue?Upd MetricFinish

book
Control and Test Groups

We have decided what criterion we will use in the future to get the final result. Now let's perform more 'checks' between groups to understand if they differ significantly.

All steps we are going to perform are to see if groups do differ. The final check with the p-value and statistical criterion will be as a sum up of everything we did.

We continue analyzing the data we received after the A/B test. Let's divide our data into 2 groups:

  • The control group that tests the old version of the site;
  • The test group that tests an updated version of the site.
Task

Swipe to start coding

  1. Create the new variable df_control with the 'control' group.
  2. Create the new variable df_test with the 'test' group.
  3. Show the first row of the df_control.
  4. Show the first row of the df_test.

Solution

Switch to desktopSwitch to desktop for real-world practiceContinue from where you are using one of the options below
Everything was clear?

How can we improve it?

Thanks for your feedback!

SectionΒ 2. ChapterΒ 4
toggle bottom row

book
Control and Test Groups

We have decided what criterion we will use in the future to get the final result. Now let's perform more 'checks' between groups to understand if they differ significantly.

All steps we are going to perform are to see if groups do differ. The final check with the p-value and statistical criterion will be as a sum up of everything we did.

We continue analyzing the data we received after the A/B test. Let's divide our data into 2 groups:

  • The control group that tests the old version of the site;
  • The test group that tests an updated version of the site.
Task

Swipe to start coding

  1. Create the new variable df_control with the 'control' group.
  2. Create the new variable df_test with the 'test' group.
  3. Show the first row of the df_control.
  4. Show the first row of the df_test.

Solution

Switch to desktopSwitch to desktop for real-world practiceContinue from where you are using one of the options below
Everything was clear?

How can we improve it?

Thanks for your feedback!

SectionΒ 2. ChapterΒ 4
Switch to desktopSwitch to desktop for real-world practiceContinue from where you are using one of the options below
We're sorry to hear that something went wrong. What happened?
some-alt