--- title: "Training Orchestrator: Unifying Model Training at Yelp" url: https://daily.dev/posts/training-orchestrator-unifying-model-training-at-yelp-2adfvgnes source_url: https://engineeringblog.yelp.com/2026/07/training-orchestrator-unifying-model-training-at-yelp.html type: article source: "Yelp Engineering" published: 2026-07-14T17:37:10.571Z updated: 2026-07-14T17:37:54.149Z tags: ["machine-learning", "apache-spark", "pydantic"] reading_time: 13 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Training Orchestrator: Unifying Model Training at Yelp **[Yelp Engineering](https://daily.dev/sources/yelp)** · 13 min read · 0 upvotes · 0 comments ## Summary Yelp's Core ML Team built Training Orchestrator to unify fragmented model training workflows across applied ML teams. Previously, each team maintained monolithic Spark scripts with duplicated boilerplate, scattered validation, and no local testability. The new system introduces a declarative, configuration-driven approach using Pydantic for type-safe configs, a DAG-based execution engine for step ordering, automatic MLflow integration for experiment tracking and reproducibility, and built-in Slack notifications. Steps are decoupled from infrastructure, enabling local runs, unit testing, and environment parity. Key outcomes include faster feedback loops, centralized configuration as a single source of truth, and reproducible runs via versioned MLflow artifacts. Future plans include first-class declarative steps for model evaluation and lineage tracking. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Yelp Unifies ML Model Training with Training Orchestrator](https://daily.dev/posts/yelp-unifies-ml-model-training-with-training-orchestrator-yiioqmkee) · InfoQ · 0 upvotes · 0 comments - [OrchestraML: From English prompt to deployed ML model with human approval](https://daily.dev/posts/orchestraml-from-english-prompt-to-deployed-ml-model-with-human-approval-1rr4pmnn6) · Product Hunt · 1 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#apache-spark](https://daily.dev/tags/apache-spark), [#pydantic](https://daily.dev/tags/pydantic) [View this post on daily.dev](https://daily.dev/posts/training-orchestrator-unifying-model-training-at-yelp-2adfvgnes)