--- title: Mixture of Experts News & Updates | daily.dev description: Mixture of Experts news covering a model architecture that routes each input to a subset of specialised subnetworks instead of activating all parameters. Readers can learn about routing and gating mechanisms, sparse activation and parameter counts, training stability. canonical: https://daily.dev/tags/mixture-of-experts twitter:card: summary_large_image twitter:site: @dailydotdev og:url: https://daily.dev/tags/mixture-of-experts og:type: website og:site_name: daily.dev og:title: Mixture of Experts News & Updates | daily.dev og:description: Mixture of Experts news covering a model architecture that routes each input to a subset of specialised subnetworks instead of activating all parameters. Readers can learn about routing and gating mechanisms, sparse activation and parameter counts, training stability. og:image: https://api.daily.dev/og/tags/mixture-of-experts.png og:image:width: 1200 og:image:height: 630 --- ## Recommended Mixture of Experts stories ## Who to follow for Mixture of Experts [](https://daily.dev/feigle) [Win](https://daily.dev/feigle) [@feigle](https://daily.dev/feigle) Joined Jul 7\. 2026 50 Head of Growth @ Vast.ai [](https://daily.dev/andrewma) [Andrew M](https://daily.dev/andrewma) [@andrewma](https://daily.dev/andrewma) Joined Jun 19\. 2025 2K full time overthinker [](https://daily.dev/geekluffy) [GeekLuffy](https://daily.dev/geekluffy) [@geekluffy](https://daily.dev/geekluffy) Joined Apr 3\. 2026 1.3K Full-Stack & AI Engineer building scalable web apps & high-performance edge solutions. ## Top sources covering Mixture of Experts ## Most upvoted Mixture of Experts posts ## Best discussed Mixture of Experts posts ## All posts about Mixture of Experts ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@graph":[{"@type":"CollectionPage","@id":"https://daily.dev/tags/mixture-of-experts#page","url":"https://daily.dev/tags/mixture-of-experts","name":"Mixture of Experts News & Updates","description":"Mixture of Experts news covering a model architecture that routes each input to a subset of specialised subnetworks instead of activating all parameters. Readers can learn about routing and gating mechanisms, sparse activation and parameter counts, training stability.","isPartOf":{"@type":"WebSite","url":"https://daily.dev"}},{"@type":"ItemList","@id":"https://daily.dev/tags/mixture-of-experts#items","numberOfItems":10,"itemListElement":[{"@type":"ListItem","position":1,"url":"https://daily.dev/posts/researchers-from-princeton-and-meta-ai-introduce-lory-a-fully-differentiable-moe-model-designed-f-qcrefh8v9","name":"Researchers from Princeton and Meta AI Introduce ‘Lory’: A Fully-Differentiable MoE Model Designed for Autoregressive Language Model Pre-Training"},{"@type":"ListItem","position":2,"url":"https://daily.dev/posts/this-ai-paper-by-deepseek-ai-introduces-deepseek-v2-harnessing-mixture-of-experts-for-enhanced-ai-p-89cppmuow","name":"This AI Paper by DeepSeek-AI Introduces DeepSeek-V2: Harnessing Mixture-of-Experts for Enhanced AI Performance"},{"@type":"ListItem","position":3,"url":"https://daily.dev/posts/mixture-of-expert-architecture-definitions-and-applications-included-google-s-gemini-and-mixtral-8x-5mq5thfbs","name":"Mixture of Expert Architecture. Definitions and Applications included Google’s Gemini and Mixtral 8x7B"},{"@type":"ListItem","position":4,"url":"https://daily.dev/posts/bringing-megablocks-to-databricks-a5qsf3bo6","name":"Bringing MegaBlocks to Databricks"},{"@type":"ListItem","position":5,"url":"https://daily.dev/posts/how-do-mixture-of-experts-layers-affect-transformer-models--gu7iszycd","name":"How do mixture-of-experts layers affect transformer models?"},{"@type":"ListItem","position":6,"url":"https://daily.dev/posts/alibaba-releases-qwen1-5-moe-a2-7b-a-small-moe-model-with-only-2-7b-activated-parameters-yet-matchi-y4t2xirgw","name":"Alibaba Releases Qwen1.5-MoE-A2.7B: A Small MoE Model with only 2.7B Activated Parameters yet Matching the Performance of State-of-the-Art 7B models like Mistral 7B"},{"@type":"ListItem","position":7,"url":"https://daily.dev/posts/create-mixtures-of-experts-with-mergekit-qx7fhuo1o","name":"Create Mixtures of Experts with MergeKit"},{"@type":"ListItem","position":8,"url":"https://daily.dev/posts/understanding-the-sparse-mixture-of-experts-smoe-layer-in-mixtral-vprnrg2ie","name":"Understanding the Sparse Mixture of Experts (SMoE) Layer in Mixtral"},{"@type":"ListItem","position":9,"url":"https://daily.dev/posts/mixtral-8x7b-overview-and-benchmarks-with-combining-mixtral-and-flash-attention-2-3vtfjuoy2","name":"Mixtral-8x7B: Overview and Benchmarks with Combining Mixtral and Flash Attention 2"},{"@type":"ListItem","position":10,"url":"https://daily.dev/posts/grok-1-42khh3qw7","name":"grok-1"}]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Tags","item":"https://daily.dev/tags"},{"@type":"ListItem","position":3,"name":"Mixture of Experts"}]}]} ```