--- title: Yelp Unifies ML Model Training with Training Orchestrator description: Yelp has built an internal framework called Training Orchestrator to unify ML model training across teams. It replaces fragmented, monolithic Spark scripts... canonical: https://daily.dev/posts/yelp-unifies-ml-model-training-with-training-orchestrator-yiioqmkee twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Yelp Unifies ML Model Training with Training Orchestrator | daily.dev og:description: Yelp has built an internal framework called Training Orchestrator to unify ML model training across teams. It replaces fragmented, monolithic Spark scripts... og:url: https://daily.dev/posts/yelp-unifies-ml-model-training-with-training-orchestrator-yiioqmkee og:image: https://api.daily.dev/og/posts/YIIoQMkEe.png og:image:alt: Yelp Unifies ML Model Training with Training Orchestrator og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Yelp Unifies ML Model Training with Training Orchestrator **[InfoQ](https://daily.dev/sources/infoq)** · 4 min read · 0 upvotes · 0 comments ## Summary Yelp has built an internal framework called Training Orchestrator to unify ML model training across teams. It replaces fragmented, monolithic Spark scripts with a configuration-driven, DAG-based execution model using Pydantic-validated step configs and MLflow integration. The system separates training logic from cluster runtime, enabling local runs, unit testing, and automatic run logging. Key benefits include faster validation of configuration mismatches, reusable step functions across pipelines, and centralized Slack/MLflow monitoring. The approach mirrors industry trends seen at Netflix (Metaflow) and Uber (Michelangelo), where centralizing ML orchestration reduces duplication and improves reproducibility at scale. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Training Orchestrator: Unifying Model Training at Yelp](https://daily.dev/posts/training-orchestrator-unifying-model-training-at-yelp-2adfvgnes) · Yelp Engineering · 0 upvotes · 0 comments - [LyftLearn Evolution: Rethinking ML Platform Architecture](https://daily.dev/posts/lyftlearn-evolution-rethinking-ml-platform-architecture-tpztmqapa) · Lyft Engineering · 0 upvotes · 0 comments - [OrchestraML: From English prompt to deployed ML model with human approval](https://daily.dev/posts/orchestraml-from-english-prompt-to-deployed-ml-model-with-human-approval-1rr4pmnn6) · Product Hunt · 1 upvotes · 0 comments - [Lyft Rearchitects ML Platform with Hybrid AWS SageMaker-Kubernetes Approach](https://daily.dev/posts/lyft-rearchitects-ml-platform-with-hybrid-aws-sagemaker-kubernetes-approach-ntubrebjb) · InfoQ · 0 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#apache-spark](https://daily.dev/tags/apache-spark), [#pydantic](https://daily.dev/tags/pydantic) [View this post on daily.dev](https://daily.dev/posts/yelp-unifies-ml-model-training-with-training-orchestrator-yiioqmkee) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Yelp Unifies ML Model Training with Training Orchestrator","url":"https://daily.dev/posts/yelp-unifies-ml-model-training-with-training-orchestrator-yiioqmkee","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/yelp-unifies-ml-model-training-with-training-orchestrator-yiioqmkee"},"datePublished":"2026-07-21T10:01:33.995Z","dateModified":"2026-07-21T10:01:52.957Z","description":"Yelp has built an internal framework called Training Orchestrator to unify ML model training across teams. It replaces fragmented, monolithic Spark scripts...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/3a267d1f04f8ef6234b6da4faa7c5b76?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/3a267d1f04f8ef6234b6da4faa7c5b76?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"InfoQ","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"InfoQ","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/afc3bced3e1e4b188dd9127017a60e0c","url":"https://daily.dev/sources/infoq"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/yelp-unifies-ml-model-training-with-training-orchestrator-yiioqmkee","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,apache-spark,pydantic","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"InfoQ","item":"https://daily.dev/sources/infoq"},{"@type":"ListItem","position":3,"name":"Yelp Unifies ML Model Training with Training Orchestrator"}]} ```