--- title: Want to Run LLMs on Your Device? Meet MLC | daily.dev description: MLC (Machine Learning Compilation) is a framework that compiles both the model and its runtime for efficient local LLM inference on edge devices. Unlike... canonical: https://daily.dev/posts/want-to-run-llms-on-your-device-meet-mlc-kz5zl2e16 twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Want to Run LLMs on Your Device? Meet MLC | daily.dev og:description: MLC (Machine Learning Compilation) is a framework that compiles both the model and its runtime for efficient local LLM inference on edge devices. Unlike... og:url: https://daily.dev/posts/want-to-run-llms-on-your-device-meet-mlc-kz5zl2e16 og:image: https://api.daily.dev/og/posts/KZ5zL2E16.png og:image:alt: Want to Run LLMs on Your Device? Meet MLC og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Want to Run LLMs on Your Device? Meet MLC **[Callstack Blog](https://daily.dev/sources/callstack-blog)** · 4 min read · 0 upvotes · 0 comments ## Summary MLC (Machine Learning Compilation) is a framework that compiles both the model and its runtime for efficient local LLM inference on edge devices. Unlike TensorFlow Lite, ONNX Runtime, or Core ML, MLC targets any environment that supports C++, making it cross-platform across Android, iOS, web, and macOS. It analyzes a model's architecture, strips out unnecessary functions, and produces a lightweight optimized runtime. Practical usage involves converting a model (e.g., LLaMA or Mistral), compiling the runtime for the target platform, and bundling both into an app. Hardware limits still apply — model size (3B, 7B, 70B) determines feasibility on a given device, not the framework itself. MLC is open-source and currently focused on LLMs, with potential to support other model types in the future. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: --- Tags: [#llm](https://daily.dev/tags/llm), [#react-native](https://daily.dev/tags/react-native) [View this post on daily.dev](https://daily.dev/posts/want-to-run-llms-on-your-device-meet-mlc-kz5zl2e16) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Want to Run LLMs on Your Device? Meet MLC","url":"https://daily.dev/posts/want-to-run-llms-on-your-device-meet-mlc-kz5zl2e16","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/want-to-run-llms-on-your-device-meet-mlc-kz5zl2e16"},"datePublished":"2026-03-22T11:30:55.190Z","dateModified":"2026-03-22T11:35:30.120Z","description":"MLC (Machine Learning Compilation) is a framework that compiles both the model and its runtime for efficient local LLM inference on edge devices. Unlike...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/2b55343e609975b50bd21f420a02f229?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/2b55343e609975b50bd21f420a02f229?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Callstack Blog","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Callstack Blog","logo":"https://media.daily.dev/image/upload/s--3qItoroi--/f_auto,q_auto/v1774179048/logos/callstack-blog?_a=BAMAMiWQ0","url":"https://daily.dev/sources/callstack-blog"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/want-to-run-llms-on-your-device-meet-mlc-kz5zl2e16","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"llm,react-native","timeRequired":"PT4M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Callstack Blog","item":"https://daily.dev/sources/callstack-blog"},{"@type":"ListItem","position":3,"name":"Want to Run LLMs on Your Device? Meet MLC"}]} ```