Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Learn Upd Metric | Performing One More AB Test
A/B Testing in Python

bookUpd Metric

Do you recall we talked about the fact that we have to be careful while choosing metrics for the A/B test? Let's try to add one metric to check if the result differs. For example, we may try to find if the result changes if we use only users that have been to the site earlier.

Task

Swipe to start coding

  1. Create the data that includes users that have visited the site for the first time using the 'first_visit_after_test_start' column.
  2. Perform the statistical analysis with the Mann-Whitney criterion.

Solution

Everything was clear?

How can we improve it?

Thanks for your feedback!

SectionΒ 3. ChapterΒ 10
single

single

Ask AI

expand

Ask AI

ChatGPT

Ask anything or try one of the suggested questions to begin our chat

Suggested prompts:

Summarize this chapter

Explain the code in file

Explain why file doesn't solve the task

close

Awesome!

Completion rate improved to 4.55

bookUpd Metric

Swipe to show menu

Do you recall we talked about the fact that we have to be careful while choosing metrics for the A/B test? Let's try to add one metric to check if the result differs. For example, we may try to find if the result changes if we use only users that have been to the site earlier.

Task

Swipe to start coding

  1. Create the data that includes users that have visited the site for the first time using the 'first_visit_after_test_start' column.
  2. Perform the statistical analysis with the Mann-Whitney criterion.

Solution

Switch to desktopSwitch to desktop for real-world practiceContinue from where you are using one of the options below
Everything was clear?

How can we improve it?

Thanks for your feedback!

close

Awesome!

Completion rate improved to 4.55
SectionΒ 3. ChapterΒ 10
single

single

some-alt