Quadratic Regression
The Problem with Linear Regression
Before defining the Polynomial Regression, we'll take a look at the case that the Linear Regression we have learned before doesn't handle well.
Here you can see that our simple linear regression model is doing awful. That is because it tries to fit a straight line to the data points. Yet we can notice that fitting a parabola would be a much better choice for our points.
Quadratic Regression Equation
To build a straight-line model, we used an equation of a line (y=ax+b). So to build a parabolic model, we need the equation of a parabola. That is the quadratic equation: y=axยฒ+bx+c. Changing the a, b, and c to ฮฒ would give us the Quadratic Regression Equation:
The model this equation describes is called Quadratic Regression. Like before, we only need to find the best parameters for our data points.
Normal Equation and Xฬ
As always, the Normal Equation handles finding the best parameters. But we need to define the Xฬ properly.
We already know how to build the Xฬ matrix for Multiple Linear Regression. It turns out the Xฬ matrix for Polynomial Regression is constructed similarly. We can think of xยฒ as a second feature. This way, we need to add a corresponding new column to the Xฬ. It will hold the same values as the previous column but squared.
The video below shows how to build the Xฬ.
Thanks for your feedback!
Ask AI
Ask AI
Ask anything or try one of the suggested questions to begin our chat
Awesome!
Completion rate improved to 5.26Quadratic Regression
Swipe to show menu
The Problem with Linear Regression
Before defining the Polynomial Regression, we'll take a look at the case that the Linear Regression we have learned before doesn't handle well.
Here you can see that our simple linear regression model is doing awful. That is because it tries to fit a straight line to the data points. Yet we can notice that fitting a parabola would be a much better choice for our points.
Quadratic Regression Equation
To build a straight-line model, we used an equation of a line (y=ax+b). So to build a parabolic model, we need the equation of a parabola. That is the quadratic equation: y=axยฒ+bx+c. Changing the a, b, and c to ฮฒ would give us the Quadratic Regression Equation:
The model this equation describes is called Quadratic Regression. Like before, we only need to find the best parameters for our data points.
Normal Equation and Xฬ
As always, the Normal Equation handles finding the best parameters. But we need to define the Xฬ properly.
We already know how to build the Xฬ matrix for Multiple Linear Regression. It turns out the Xฬ matrix for Polynomial Regression is constructed similarly. We can think of xยฒ as a second feature. This way, we need to add a corresponding new column to the Xฬ. It will hold the same values as the previous column but squared.
The video below shows how to build the Xฬ.
Thanks for your feedback!
