scikit-learn
Official docs outline
14 sections- Supervised learning
Linear models, SVMs, trees, ensembles, and neighbors for classification and regression.
- Unsupervised learning
Clustering, decomposition, and density estimation.
- Model selection and evaluation
Cross-validation, hyperparameter search, and metrics.
- Cross-validation
K-fold, stratified and group splitters, and avoiding leakage.
- Hyperparameter tuning
GridSearchCV, RandomizedSearchCV, and successive halving.
- Metrics and scoring
Scoring parameters, classification, regression, and clustering metrics.
- Preprocessing data
Scaling, encoding categorical features, imputation, and transformers.
- Pipelines and composite estimators
Pipeline, ColumnTransformer, and FeatureUnion.
- Feature selection
Univariate, recursive, and model-based feature selection.
- Ensemble methods
Random forests, gradient boosting, bagging, and stacking.
- Dimensionality reduction
PCA, NMF, and related decompositions.
- Common pitfalls and recommended practices
Data leakage, inconsistent preprocessing, and randomness control.
- Model persistence
Saving models with pickle, joblib, and ONNX and security concerns.
- Inspection
Partial dependence and permutation importance for interpretation.
Each section links to the official page. Titles and summaries by Extra Credit; the docs belong to their authors.