Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Lære Now We Can Answer | The First A/B Test
A/B Testing in Python
course content

Kursusindhold

A/B Testing in Python

A/B Testing in Python

1. What is A/B Test?
A/B Test and our GoalMetrics and HypothesisHow Not to Fail a Test
2. The First A/B Test
Data StudyWhat Criterion to ChooseCriterionControl and Test GroupsPlots to CompareIntervals to CompareNow We Can AnswerTo Sum Up
3. Performing One More AB Test
Data StudyPreparationPreprocessing DataChoosing the CriterionCriterionDividing into GroupsComparing GroupsWhat to Do with the ButtonPink or Blue?Upd MetricFinish

book
Now We Can Answer

This chapter will help us to answer the question 'Can we believe that the variant of the site will help us to increase in clicks?'

So, we have studied how do 2 groups' distributions look like:

  • Their plots don't look similar;
  • Their confidence intervals don' cover each other a lot.

Earlier, we decided that we were going to use t-criterion criterion to cope with our problem. It is our last check to prove whether there is a NON-RANDOM difference between groups.

To perform the t-test use scipy.stats.ttest_ind(control_group_data, test_group_data).

Opgave

Swipe to start coding

  1. Perform the t-test.

Løsning

Switch to desktopSkift til skrivebord for at øve i den virkelige verdenFortsæt der, hvor du er, med en af nedenstående muligheder
Var alt klart?

Hvordan kan vi forbedre det?

Tak for dine kommentarer!

Sektion 2. Kapitel 7
toggle bottom row

book
Now We Can Answer

This chapter will help us to answer the question 'Can we believe that the variant of the site will help us to increase in clicks?'

So, we have studied how do 2 groups' distributions look like:

  • Their plots don't look similar;
  • Their confidence intervals don' cover each other a lot.

Earlier, we decided that we were going to use t-criterion criterion to cope with our problem. It is our last check to prove whether there is a NON-RANDOM difference between groups.

To perform the t-test use scipy.stats.ttest_ind(control_group_data, test_group_data).

Opgave

Swipe to start coding

  1. Perform the t-test.

Løsning

Switch to desktopSkift til skrivebord for at øve i den virkelige verdenFortsæt der, hvor du er, med en af nedenstående muligheder
Var alt klart?

Hvordan kan vi forbedre det?

Tak for dine kommentarer!

Sektion 2. Kapitel 7
Switch to desktopSkift til skrivebord for at øve i den virkelige verdenFortsæt der, hvor du er, med en af nedenstående muligheder
Vi beklager, at noget gik galt. Hvad skete der?
some-alt