ML Algorithm Reference TwoPage
ML Algorithm Reference TwoPage
Algorithm Type Metrics Cross Validation Performance Measures Key Hyperparameters Common Use
Linear Regression Regression MAE, MSE, RMSE, R2 K-Fold CV Low error (MAE, MSE), Hig fit_intercept, norma Predicting house prices,
h R2 lize forecasting
Logistic Regression Classification Accuracy, Precision, Reca Stratified K-Fold High classification score penalty, C, solver Spam detection, custom
ll, F1, ROC-AUC (Accuracy, F1) prediction
Decision Tree Classification Accuracy, Precision, Reca K-Fold / Stratified Interpretable, fast train max_depth, min_sampl Loan default classificatio
ll, F1 K-Fold ing es_split, criterion ecision support
Random Forest Both Accuracy, Precision, Reca K-Fold / Stratified Handles overfitting, high n_estimators, max_de Fraud detection, feature
ll, F1, ROC-AUC accuracy pth, min_samples_spl tance
it
KNN Both Accuracy, F1, Confusion M K-Fold CV Good for small datasets, n_neighbors, weights Recommender systems,
atrix sensitive to k , metric ognition (basic)
Machine Learning Algorithm Reference
Algorithm Type Metrics Cross Validation Performance Measures Key Hyperparameters Common Use
SVM Both Accuracy, Precision, Reca Stratified K-Fold Works well in high dimens C, kernel, gamma Text classification, image
ll, ROC-AUC ions ognition
Naive Bayes Classification Accuracy, Log Loss K-Fold Fast, works well with sma var_smoothing Text classification, sentim
ll data analysis
XGBoost Both Accuracy, Precision, Reca K-Fold, Stratified K Best for structured/tabul n_estimators, learni Boosted fraud detection,
ll, F1, ROC-AUC -Fold ar data ng_rate, max_depth ng tasks
K-Means Clustering Inertia, Silhouette Score Elbow Method, Silhou Best with well-separated n_clusters, init, ma Customer segmentation,
ette clusters x_iter analysis
PCA Dimensionality R Explained Variance, Singu Not Applicable Used for reducing dimensi n_components, svd_so Noise reduction, visualiz
eduction lar Values ons & noise lver , pre-processing