Ensemble learning & tree-based models

Sources:

• Classification And Regression Trees (CART) & Random Forest - Richard Alligier, David Gianazza & Pascal Lezaud
• Boosting - Richard Alligier

Sources:

• Ensemble learning - Wikipedia
• Ensemble methods: bagging, boosting and stacking

Decision tree (CART)

CART stand for Classification And Regression Tree.

• How to visualize decision trees - Terence Parr and Prince Grover
• A visual introduction to machine learning (part 1)

Decisions trees can overfit very quickly.

Random forest

See Ensemble methods: bagging, boosting and stacking

Adaptative boosting

See Ensemble methods: bagging, boosting and stacking

Gradient boosting

See Ensemble methods: bagging, boosting and stacking