Ensemble Learning

1. Basic Principles of Building Ensemble Models

What is an ensemble? How are ensembles different from standard machine-learning models? What are the types of ensembles? Let's consider the answers to these questions.

What is Ensemble of Models?

Bagging Models

Boosting Models

Stacking Models

2. Commonly Used Bagging Models

Let's consider some commonly used bagging ensemble models, the features of their use, and also apply some of them to solve real-life tasks.

Bagging Classifier

Challenge: Solving Task Using Bagging Classifier

Bagging Regressor

Challenge: Solving Task Using Bagging Regressor

Random Forest

Challenge: Determining Feature Importances Using Random Forest

ExtraTrees

3. Commonly Used Boosting Models

The mechanism of work of boosting models differs from bagging models. Now we will explore these distinctions, gain insights into utilizing model boosting for problem-solving, and illustrate its functionality through practical demonstrations.

AdaBoost Classifier

Challenge: Solving Task Using AdaBoost Classifier

Challenge: Solving Task Using AdaBoost Regressor

Gradient Boosting

XGBoost

Challenge: Solving Task Using XGBoost

4. Commonly Used Stacking Models

Let's consider some commonly used stacking ensemble models, the features of their use, and also apply some of them to solve real-life tasks.

Stacking Classifier

Challenge: Solving Task Using Stacking Classifier

Challenge: Solving Task Using Stacking Regressor

Using Ensembles As Base Models

Course Summary

Challenge: Solving Task Using AdaBoost Classifier

Tarefa

The load_wine dataset is a classic example used for classification tasks. It consists of 178 samples, each representing a different wine cultivar. The dataset comprises 13 numerical attributes that describe various chemical characteristics of the wines, including features like alcohol content, malic acid concentration, and ash content. The target variable consists of three distinct classes representing the three different cultivars.

Your task is to use AdaBoost Classifier to solve the classification problem on the load_wine dataset:

Split data into train and test sets.
Use the AdaBoostClassifier() constructor to create the model with 50 base estimators.
Note
If we don't specify the base model of AdaBoostClassifer, the Decision Tree Classifier will be used by default.

Tudo estava claro?

Seção 3. Capítulo 2

Conteúdo do Curso

Ensemble Learning

1. Basic Principles of Building Ensemble Models

What is Ensemble of Models?Bagging Models Boosting Models Stacking Models

2. Commonly Used Bagging Models

Bagging Classifier Challenge: Solving Task Using Bagging Classifier Bagging Regressor Challenge: Solving Task Using Bagging Regressor Random Forest Challenge: Determining Feature Importances Using Random Forest ExtraTrees

3. Commonly Used Boosting Models

AdaBoost Classifier Challenge: Solving Task Using AdaBoost Classifier Challenge: Solving Task Using AdaBoost Regressor Gradient Boosting XGBoost Challenge: Solving Task Using XGBoost

4. Commonly Used Stacking Models

Stacking Classifier Challenge: Solving Task Using Stacking Classifier Challenge: Solving Task Using Stacking Regressor Using Ensembles As Base Models Course Summary

Ensemble Learning

Challenge: Solving Task Using AdaBoost Classifier

Tarefa

Your task is to use AdaBoost Classifier to solve the classification problem on the load_wine dataset:

Split data into train and test sets.
Use the AdaBoostClassifier() constructor to create the model with 50 base estimators.
Note
If we don't specify the base model of AdaBoostClassifer, the Decision Tree Classifier will be used by default.

Tudo estava claro?

Seção 3. Capítulo 2