27.2 Classification Method

https://en.wikipedia.org/wiki/Category:Classification_algorithms

27.2.1 Regression

Difference between closed-form solution and SGD

27.2.2 KNN

Large margin nearest neighbor https://en.wikipedia.org/wiki/Large_margin_nearest_neighbor

27.2.3 Naive Bayes

27.2.4 LDA, QDA

27.2.5 Desicion Tree and Random Forest

27.2.6 Bagging

27.2.7 Boosting

27.2.7.1 Gradient Boost Desicion Tree (GBDT)

27.2.7.2 XGBoost

27.2.7.3 LightGBM

27.2.7.4 CATBoost

27.2.7.5 RUSBoost

27.2.8 Neighborhood components analysis (NCA)

https://en.wikipedia.org/wiki/Neighbourhood_components_analysis

27.2.9 Soft independent modelling of class analogies

https://en.wikipedia.org/wiki/Soft_independent_modelling_of_class_analogies