Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.Tune Hyperparameters with RandomizedSearchCV | Modeling
ML Introduction with scikit-learn
course content

Зміст курсу

ML Introduction with scikit-learn

ML Introduction with scikit-learn

1. Machine Learning Concepts
What is MLTypes of Machine LearningTraining SetTypes of DataMachine Learning Workflow
2. Preprocessing Data with Scikit-learn
Scikit-learn ConceptsGetting Familiar with DatasetDealing with Missing ValuesImpute Missing ValuesOrdinalEncoderOne-Hot EncoderLabelEncoderEncode Categorical VariablesWhy Scale the Data?StandardScaler, MinMaxScaler, MaxAbsScalerScale the FeaturesPreprocessing Summary
3. Pipelines
What is PipelineColumnTransformerPipelineCreating a Pipeline ChallengeFinal EstimatorCreate a Complete ML Pipeline
4. Modeling
ModelsKNeighborsClassifierEvaluating a Model. Train-Test split.Cross-ValidationEvaluate the Model with Cross-ValidationGridSearchCVThe Flaw of GridSearchCVTune Hyperparameters with RandomizedSearchCVModeling SummaryPutting It All Together

Tune Hyperparameters with RandomizedSearchCV

The idea behind RandomizedSearchCV is that it works the same as GridSearchCV, but instead of trying all the combinations, it tries a randomly sampled subset.
For example, this param_grid will have 100 combinations

The GridSearchCV would try all of them, which is time-consuming.
With RandomizedSearchCV, you can try only a randomly chosen subset of, say, 20 combinations.
It usually leads to a little worse result, but it is much faster.
You can control the number of combinations to be tested using the n_iter argument (set to 10 by default). Apart from that, working with it is the same as with GridSearchCV.

Завдання

Your task is to build GridSearchCV and RandomizedSearchCV with 20 combinations and compare the results.

  1. Initialize the RandomizedSearchCV object. Pass the parameters grid and set the number of combinations to 20.
  2. Initialize the GridSearchCV object.
  3. Train both GridSearchCV and RandomizedSearchCV objects.
  4. Print the best estimator of grid.
  5. Print the best score of randomized.

Завдання

Your task is to build GridSearchCV and RandomizedSearchCV with 20 combinations and compare the results.

  1. Initialize the RandomizedSearchCV object. Pass the parameters grid and set the number of combinations to 20.
  2. Initialize the GridSearchCV object.
  3. Train both GridSearchCV and RandomizedSearchCV objects.
  4. Print the best estimator of grid.
  5. Print the best score of randomized.

Note

You can try running the code several times. Look at the difference between the two scores. Sometimes the scores can be the same due to the presence of the best parameters among combinations sampled by RandomizedSearchCV.

Все було зрозуміло?

Секція 4. Розділ 8
toggle bottom row

Tune Hyperparameters with RandomizedSearchCV

The idea behind RandomizedSearchCV is that it works the same as GridSearchCV, but instead of trying all the combinations, it tries a randomly sampled subset.
For example, this param_grid will have 100 combinations

The GridSearchCV would try all of them, which is time-consuming.
With RandomizedSearchCV, you can try only a randomly chosen subset of, say, 20 combinations.
It usually leads to a little worse result, but it is much faster.
You can control the number of combinations to be tested using the n_iter argument (set to 10 by default). Apart from that, working with it is the same as with GridSearchCV.

Завдання

Your task is to build GridSearchCV and RandomizedSearchCV with 20 combinations and compare the results.

  1. Initialize the RandomizedSearchCV object. Pass the parameters grid and set the number of combinations to 20.
  2. Initialize the GridSearchCV object.
  3. Train both GridSearchCV and RandomizedSearchCV objects.
  4. Print the best estimator of grid.
  5. Print the best score of randomized.

Завдання

Your task is to build GridSearchCV and RandomizedSearchCV with 20 combinations and compare the results.

  1. Initialize the RandomizedSearchCV object. Pass the parameters grid and set the number of combinations to 20.
  2. Initialize the GridSearchCV object.
  3. Train both GridSearchCV and RandomizedSearchCV objects.
  4. Print the best estimator of grid.
  5. Print the best score of randomized.

Note

You can try running the code several times. Look at the difference between the two scores. Sometimes the scores can be the same due to the presence of the best parameters among combinations sampled by RandomizedSearchCV.

Все було зрозуміло?

Секція 4. Розділ 8
toggle bottom row

Tune Hyperparameters with RandomizedSearchCV

The idea behind RandomizedSearchCV is that it works the same as GridSearchCV, but instead of trying all the combinations, it tries a randomly sampled subset.
For example, this param_grid will have 100 combinations

The GridSearchCV would try all of them, which is time-consuming.
With RandomizedSearchCV, you can try only a randomly chosen subset of, say, 20 combinations.
It usually leads to a little worse result, but it is much faster.
You can control the number of combinations to be tested using the n_iter argument (set to 10 by default). Apart from that, working with it is the same as with GridSearchCV.

Завдання

Your task is to build GridSearchCV and RandomizedSearchCV with 20 combinations and compare the results.

  1. Initialize the RandomizedSearchCV object. Pass the parameters grid and set the number of combinations to 20.
  2. Initialize the GridSearchCV object.
  3. Train both GridSearchCV and RandomizedSearchCV objects.
  4. Print the best estimator of grid.
  5. Print the best score of randomized.

Завдання

Your task is to build GridSearchCV and RandomizedSearchCV with 20 combinations and compare the results.

  1. Initialize the RandomizedSearchCV object. Pass the parameters grid and set the number of combinations to 20.
  2. Initialize the GridSearchCV object.
  3. Train both GridSearchCV and RandomizedSearchCV objects.
  4. Print the best estimator of grid.
  5. Print the best score of randomized.

Note

You can try running the code several times. Look at the difference between the two scores. Sometimes the scores can be the same due to the presence of the best parameters among combinations sampled by RandomizedSearchCV.

Все було зрозуміло?

The idea behind RandomizedSearchCV is that it works the same as GridSearchCV, but instead of trying all the combinations, it tries a randomly sampled subset.
For example, this param_grid will have 100 combinations

The GridSearchCV would try all of them, which is time-consuming.
With RandomizedSearchCV, you can try only a randomly chosen subset of, say, 20 combinations.
It usually leads to a little worse result, but it is much faster.
You can control the number of combinations to be tested using the n_iter argument (set to 10 by default). Apart from that, working with it is the same as with GridSearchCV.

Завдання

Your task is to build GridSearchCV and RandomizedSearchCV with 20 combinations and compare the results.

  1. Initialize the RandomizedSearchCV object. Pass the parameters grid and set the number of combinations to 20.
  2. Initialize the GridSearchCV object.
  3. Train both GridSearchCV and RandomizedSearchCV objects.
  4. Print the best estimator of grid.
  5. Print the best score of randomized.

Note

You can try running the code several times. Look at the difference between the two scores. Sometimes the scores can be the same due to the presence of the best parameters among combinations sampled by RandomizedSearchCV.

Секція 4. Розділ 8
Перейдіть на комп'ютер для реальної практикиПродовжуйте з того місця, де ви зупинились, використовуючи один з наведених нижче варіантів
We're sorry to hear that something went wrong. What happened?
some-alt