--- title: Bagging as a regularizer | daily.dev description: A technique using bagging (bootstrap aggregating) as a regularizer is explored, where instead of training a single Gradient Boosted Decision Tree, 100 smaller... canonical: https://daily.dev/posts/bagging-as-a-regularizer-fca2uleyn twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Bagging as a regularizer | daily.dev og:description: A technique using bagging (bootstrap aggregating) as a regularizer is explored, where instead of training a single Gradient Boosted Decision Tree, 100 smaller... og:url: https://daily.dev/posts/bagging-as-a-regularizer-fca2uleyn og:image: https://api.daily.dev/og/posts/fCa2uLeyn.png og:image:alt: Bagging as a regularizer og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Bagging as a regularizer **[Erik Bernhardsson](https://daily.dev/sources/erikbernhardsson)** · 3 min read · 0 upvotes · 0 comments ## Summary A technique using bagging (bootstrap aggregating) as a regularizer is explored, where instead of training a single Gradient Boosted Decision Tree, 100 smaller GBDTs are trained on heavily subsampled data. The spread of predictions across these models approximates the uncertainty of each prediction. By penalizing uncertain estimates (e.g., using the 20th percentile of predictions), false positives can be reduced — particularly useful in recommendation systems where conservative, high-confidence predictions are preferred over risky ones. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [The Machine Learning “Advent Calendar” Day 19: Bagging in Excel](https://daily.dev/posts/the-machine-learning-advent-calendar-day-19-bagging-in-excel-7su58lypb) · Towards Data Science · 0 upvotes · 0 comments - [The Machine Learning “Advent Calendar” Day 21: Gradient Boosted Decision Tree Regressor in Excel](https://daily.dev/posts/the-machine-learning-advent-calendar-day-21-gradient-boosted-decision-tree-regressor-in-excel-7hgnbjjwp) · Towards Data Science · 0 upvotes · 0 comments - [A Simple Implementation of Boosting Algorithm](https://daily.dev/posts/a-simple-implementation-of-boosting-algorithm-i3zjuzhpl) · Daily Dose of Data Science \| Avi Chawla \| Substack · 1 upvotes · 0 comments - [Train Classical ML Models on Large Datasets](https://daily.dev/posts/train-classical-ml-models-on-large-datasets-jxzcrdobf) · Daily Dose of Data Science \| Avi Chawla \| Substack · 0 upvotes · 0 comments - [Top Gradient Boosting Methods](https://daily.dev/posts/top-gradient-boosting-methods-5ntnsgx1c) · Daily Dose of Data Science \| Avi Chawla \| Substack · 1 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#scikit](https://daily.dev/tags/scikit) [View this post on daily.dev](https://daily.dev/posts/bagging-as-a-regularizer-fca2uleyn) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Bagging as a regularizer","url":"https://daily.dev/posts/bagging-as-a-regularizer-fca2uleyn","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/bagging-as-a-regularizer-fca2uleyn"},"datePublished":"2026-03-26T08:35:30.131Z","dateModified":"2026-03-26T08:41:12.635Z","description":"A technique using bagging (bootstrap aggregating) as a regularizer is explored, where instead of training a single Gradient Boosted Decision Tree, 100 smaller...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/d6b84a135e85ad658b89bb151a7ead5a?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/d6b84a135e85ad658b89bb151a7ead5a?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Erik Bernhardsson","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Erik Bernhardsson","logo":"https://media.daily.dev/image/upload/s--SlM88DTW--/f_auto,q_auto/v1774514112/logos/erikbernhardsson?_a=BAMAMiWQ0","url":"https://daily.dev/sources/erikbernhardsson"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/bagging-as-a-regularizer-fca2uleyn","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,scikit","timeRequired":"PT3M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Erik Bernhardsson","item":"https://daily.dev/sources/erikbernhardsson"},{"@type":"ListItem","position":3,"name":"Bagging as a regularizer"}]} ```