--- title: Docker Model Runner Adds vLLM Support on macOS | daily.dev description: Docker Model Runner now supports vllm-metal, a new backend enabling vLLM inference on macOS with Apple Silicon's Metal GPU. Developed collaboratively by Docker... canonical: https://daily.dev/posts/docker-model-runner-adds-vllm-support-on-macos-1lss5kmxo twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Docker Model Runner Adds vLLM Support on macOS | daily.dev og:description: Docker Model Runner now supports vllm-metal, a new backend enabling vLLM inference on macOS with Apple Silicon's Metal GPU. Developed collaboratively by Docker... og:url: https://daily.dev/posts/docker-model-runner-adds-vllm-support-on-macos-1lss5kmxo og:image: https://api.daily.dev/og/posts/1lss5KmxO.png og:image:alt: Docker Model Runner Adds vLLM Support on macOS og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Docker Model Runner Adds vLLM Support on macOS **[Docker](https://daily.dev/sources/docker)** · 7 min read · 1 upvotes · 0 comments ## Summary Docker Model Runner now supports vllm-metal, a new backend enabling vLLM inference on macOS with Apple Silicon's Metal GPU. Developed collaboratively by Docker and the vLLM project, vllm-metal unifies MLX and PyTorch under a single compute pathway, leveraging Apple Silicon's unified memory for zero-copy tensor operations and paged attention for efficient KV cache management. The backend runs natively on the host (not in containers) due to Metal GPU access requirements, and is compatible with MLX-format safetensors models from the mlx-community on Hugging Face. Docker has open-sourced vllm-metal under the vLLM GitHub organization. Benchmarks show llama.cpp is ~1.2x faster in raw throughput, but vllm-metal brings the full vLLM ecosystem (OpenAI-compatible API, scheduler, batching) to Mac. Docker Desktop 4.62+ is required, and installation is a single command. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Announcing vllm-metal: Concurrent Serving on Apple Silicon](https://daily.dev/posts/announcing-vllm-metal-concurrent-serving-on-apple-silicon-qubj1vfph) · vLLM · 0 upvotes · 0 comments - [Docker Model Runner \+ vLLM: High-Throughput Inference](https://daily.dev/posts/docker-model-runner-vllm-high-throughput-inference-0lq7wedak) · Docker · 0 upvotes · 0 comments - [Your Local LLM Could Be Leaving Mac Performance on the Table](https://daily.dev/posts/your-local-llm-could-be-leaving-mac-performance-on-the-table-fxxfy93gy) · Medium · 0 upvotes · 0 comments - [I ditched Ollama for Docker, and my local LLM setup finally stopped being a hassle](https://daily.dev/posts/i-ditched-ollama-for-docker-and-my-local-llm-setup-finally-stopped-being-a-hassle-8b7ururzn) · XDA Developers · 1 upvotes · 0 comments - [Docker Model Runner Adds vLLM Support on Windows](https://daily.dev/posts/docker-model-runner-adds-vllm-support-on-windows-nlfijbyki) · Docker · 0 upvotes · 0 comments --- Tags: [#ai-inference](https://daily.dev/tags/ai-inference), [#vllm](https://daily.dev/tags/vllm) [View this post on daily.dev](https://daily.dev/posts/docker-model-runner-adds-vllm-support-on-macos-1lss5kmxo) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Docker Model Runner Adds vLLM Support on macOS","url":"https://daily.dev/posts/docker-model-runner-adds-vllm-support-on-macos-1lss5kmxo","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/docker-model-runner-adds-vllm-support-on-macos-1lss5kmxo"},"datePublished":"2026-02-26T14:44:57.205Z","dateModified":"2026-10-14T02:35:41.086Z","description":"Docker Model Runner now supports vllm-metal, a new backend enabling vLLM inference on macOS with Apple Silicon's Metal GPU. Developed collaboratively by Docker...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/7be8a0db8ab91f7126d8d6f3da0e7f7f?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/7be8a0db8ab91f7126d8d6f3da0e7f7f?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Docker","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Docker","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/8a1022bebfc04a7d824c309bd3686787","url":"https://daily.dev/sources/docker"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/docker-model-runner-adds-vllm-support-on-macos-1lss5kmxo","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"ai-inference,vllm","timeRequired":"PT7M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Docker","item":"https://daily.dev/sources/docker"},{"@type":"ListItem","position":3,"name":"Docker Model Runner Adds vLLM Support on macOS"}]} ```