Gradient Boosting by Hand: Residuals, Stumps & a Learning Rate
This lesson is part of the course
In this lesson
You run three rounds of gradient boosting for a regression target: start from the mean, fit a one-split stump to the residuals, add it with a learning rate, and watch the error fall.
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Entropy & Gini: How Mixed Is a Node? Locked
- Information Gain: Scoring Candidate Splits with COUNTIFS Locked
- The Best Numeric Threshold: Trying Every Cut-Point Locked
- Growing a Two-Level Tree: Leaves & Nested IF Predictions Locked
- Overfitting & Pruning: Train vs Test Accuracy by Depth Locked
- Bagging & Random Forests: Majority Vote and Out-of-Bag Rows Locked
- Gradient Boosting by Hand: Residuals, Stumps & a Learning Rate Locked
- Feature Importance from Impurity Decrease Locked