Common Machine Learning Models

Last updated: January 18, 2021

Types of modeling tasks

Based on Michael J. Garbade’s Medium post:

	Supervised learning	Unsupervised learning
Categorical predictors	Classification	Clustering
Continuous predictors	Regression	Density estimation, dimension reduction

Common types of models

Classification
- Decision tree learning methods, including Random forest
- Gradient boosting
- K-nearest neighbors (KNN)
- Naive Bayes classifier
- Support vector machines
Clustering
- K-means clustering
- Support vector machines
Regression
- Decision tree learning methods, including Random forest
- Gradient boosting
- K-nearest neighbors (KNN)
- Linear regression
- Logistic regression
Density estimation¹
- Kernel density estimation
Dimensional reduction
- Principal component analysis

In other words, estimate a probability density function for a random variable ^[return]