Cursusinhoud

Ensemble Learning

1. Basic Principles of Building Ensemble Models

What is Ensemble of Models?Bagging Models Boosting Models Stacking Models

2. Commonly Used Bagging Models

Bagging Classifier Challenge: Solving Task Using Bagging Classifier Bagging Regressor Challenge: Solving Task Using Bagging Regressor Random Forest Challenge: Determining Feature Importances Using Random Forest ExtraTrees

3. Commonly Used Boosting Models

AdaBoost Classifier Challenge: Solving Task Using AdaBoost Classifier Challenge: Solving Task Using AdaBoost Regressor Gradient Boosting XGBoost Challenge: Solving Task Using XGBoost

4. Commonly Used Stacking Models

Stacking Classifier Challenge: Solving Task Using Stacking Classifier Challenge: Solving Task Using Stacking Regressor Using Ensembles As Base Models Course Summary

Challenge: Solving Task Using Stacking Regressor

Stacking Regressor is a stacking ensemble learning model used to solve regression tasks. The principle of work of this model is similar to the Stacking Classifier: the only difference is that we use regression algorithms as the base and meta-models of the ensemble.
We can use the StackingRegressor class from the sklearn library to implement this model in Python.

Taak

Swipe to start coding

The make_friedman1 dataset is a synthetic dataset frequently used for regression tasks in machine learning. This dataset is widely used in regression tutorials and experimentation because it's simple, yet it can be customized with different noise levels and feature dimensions to simulate various regression scenarios.

Your task is to solve the regression task on the Friedman dataset using Stacking Regressor:

Provide split on train and test subsets of the training set: the proportion of the dataset to be included in the test split must be 0.2.
Use Decision Tree Regressor with max_depth equals 3 as one of the base models.
Create a Stacking Regressor model using base models and meta model.
Fit Stacking Regressor model on the training data.

Oplossing

Schakel over naar desktop voor praktijkervaringGa verder vanaf waar je bent met een van de onderstaande opties

Was alles duidelijk?

Bedankt voor je feedback!

Sectie 4. Hoofdstuk 3

Challenge: Solving Task Using Stacking Regressor

Taak

Swipe to start coding

Your task is to solve the regression task on the Friedman dataset using Stacking Regressor:

Provide split on train and test subsets of the training set: the proportion of the dataset to be included in the test split must be 0.2.
Use Decision Tree Regressor with max_depth equals 3 as one of the base models.
Create a Stacking Regressor model using base models and meta model.
Fit Stacking Regressor model on the training data.

Oplossing

Schakel over naar desktop voor praktijkervaringGa verder vanaf waar je bent met een van de onderstaande opties

Was alles duidelijk?

Bedankt voor je feedback!

Sectie 4. Hoofdstuk 3

Schakel over naar desktop voor praktijkervaringGa verder vanaf waar je bent met een van de onderstaande opties