Machine Learning Pills
Read post

Notebook drop - Available only for 48-hours!

This title could be clearer and more informative.Try out Clickbait Shieldfor free (5 uses left this month).

A companion Jupyter notebook to a field guide on tree-based ML models, designed to empirically verify key claims about CART, Random Forest, Extra Trees, AdaBoost, Gradient Boosting, Histogram Gradient Boosting, and Isolation Forest. Using a simulated 12,000-row subscription conversion dataset with intentional noise, the notebook demonstrates: why feature scaling is irrelevant for trees, why extrapolation is structurally impossible, how different metrics produce different model rankings, how bagging reduces variance, how boosting overfits without early stopping, and why impurity-based feature importance (MDI) can reward useless high-cardinality columns while permutation importance on held-out data does not. All experiments run on numpy, pandas, matplotlib, and scikit-learn with no extra installs.

    #machine-learning#python#scikit
Aug 03•4m read time•From mlpills.substack.com
Post cover image
Table of contents
Scaling really is irrelevantExtrapolation really is impossibleNo single metric ranks the modelsBagging cuts variance, visiblyBoosting needs a stopping ruleImpurity importance rewards the noise columnWhat the ranking is worth commerciallyTrees without a targetAlso in thereRunning it
241 Impressions
Machine Learning Pills's image
Machine Learning Pills

MLPills is a dedicated platform for machine learning enthusiasts, data scientists, and AI practition...

110 Followers

•

26 Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard