Cursusinhoud

Ensemble Learning

1. Basic Principles of Building Ensemble Models

What is Ensemble of Models?Bagging Models Boosting Models Stacking Models

2. Commonly Used Bagging Models

Bagging Classifier Challenge: Solving Task Using Bagging Classifier Bagging Regressor Challenge: Solving Task Using Bagging Regressor Random Forest Challenge: Determining Feature Importances Using Random Forest ExtraTrees

3. Commonly Used Boosting Models

AdaBoost Classifier Challenge: Solving Task Using AdaBoost Classifier Challenge: Solving Task Using AdaBoost Regressor Gradient Boosting XGBoost Challenge: Solving Task Using XGBoost

4. Commonly Used Stacking Models

Stacking Classifier Challenge: Solving Task Using Stacking Classifier Challenge: Solving Task Using Stacking Regressor Using Ensembles As Base Models Course Summary

Challenge: Determining Feature Importances Using Random Forest

Random Forest can determine feature importances, and it's one of its useful features. Feature importance is a measure that quantifies the contribution of each feature in the dataset to the predictive performance of the Random Forest model.
To determine feature importance, we must conduct the following steps:

Train the Random Forest model on the necessary dataset.
Use the .feature_importances_ attribute of the trained model to get the importance values of all features. This attribute returns an array of values, each corresponding to the importance of a specific feature in the dataset. The values are normalized and sum up to 1, making comparing the relative importance of different features easier.

Taak

Swipe to start coding

The 'heart_disease' dataset is a commonly used dataset for binary classification tasks in machine learning. It contains various medical attributes related to patients' health and aims to predict the presence or absence of heart disease in an individual.

Your task is to determine the importance of features of the heart disease dataset:

Use RandomForestClassifier class to create a model.
Fit the classifier on the dataset.
Find the importance of all features.

Oplossing

Schakel over naar desktop voor praktijkervaringGa verder vanaf waar je bent met een van de onderstaande opties

Was alles duidelijk?

Bedankt voor je feedback!

Sectie 2. Hoofdstuk 6

Challenge: Determining Feature Importances Using Random Forest

Train the Random Forest model on the necessary dataset.
Use the .feature_importances_ attribute of the trained model to get the importance values of all features. This attribute returns an array of values, each corresponding to the importance of a specific feature in the dataset. The values are normalized and sum up to 1, making comparing the relative importance of different features easier.

Taak

Swipe to start coding

Your task is to determine the importance of features of the heart disease dataset:

Use RandomForestClassifier class to create a model.
Fit the classifier on the dataset.
Find the importance of all features.

Oplossing

Schakel over naar desktop voor praktijkervaringGa verder vanaf waar je bent met een van de onderstaande opties

Was alles duidelijk?

Bedankt voor je feedback!

Sectie 2. Hoofdstuk 6

Schakel over naar desktop voor praktijkervaringGa verder vanaf waar je bent met een van de onderstaande opties