Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Learn Upd Metric | Performing One More AB Test
A/B Testing in Python
course content

Course Content

A/B Testing in Python

A/B Testing in Python

1. What is A/B Test?
A/B Test and our GoalMetrics and HypothesisHow Not to Fail a Test
2. The First A/B Test
Data StudyWhat Criterion to ChooseCriterionControl and Test GroupsPlots to CompareIntervals to CompareNow We Can AnswerTo Sum Up
3. Performing One More AB Test
Data StudyPreparationPreprocessing DataChoosing the CriterionCriterionDividing into GroupsComparing GroupsWhat to Do with the ButtonPink or Blue?Upd MetricFinish

book
Upd Metric

Do you recall we talked about the fact that we have to be careful while choosing metrics for the A/B test? Let's try to add one metric to check if the result differs. For example, we may try to find if the result changes if we use only users that have been to the site earlier.

Task

Swipe to start coding

  1. Create the data that includes users that have visited the site for the first time using the 'first_visit_after_test_start' column.
  2. Perform the statistical analysis with the Mann-Whitney criterion.

Solution

Switch to desktopSwitch to desktop for real-world practiceContinue from where you are using one of the options below
Everything was clear?

How can we improve it?

Thanks for your feedback!

Section 3. Chapter 10
toggle bottom row

book
Upd Metric

Do you recall we talked about the fact that we have to be careful while choosing metrics for the A/B test? Let's try to add one metric to check if the result differs. For example, we may try to find if the result changes if we use only users that have been to the site earlier.

Task

Swipe to start coding

  1. Create the data that includes users that have visited the site for the first time using the 'first_visit_after_test_start' column.
  2. Perform the statistical analysis with the Mann-Whitney criterion.

Solution

Switch to desktopSwitch to desktop for real-world practiceContinue from where you are using one of the options below
Everything was clear?

How can we improve it?

Thanks for your feedback!

Section 3. Chapter 10
Switch to desktopSwitch to desktop for real-world practiceContinue from where you are using one of the options below
We're sorry to hear that something went wrong. What happened?
some-alt