--- title: Run Gemma 4 with Red Hat AI on Day 0: A step-by-step guide description: Gemma 4, Google DeepMind's latest open model family, is available for immediate deployment via vLLM and Red Hat AI Inference Server. The family spans four... canonical: https://daily.dev/posts/run-gemma-4-with-red-hat-ai-on-day-0-a-step-by-step-guide-apwfnth90 twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Run Gemma 4 with Red Hat AI on Day 0: A step-by-step guide | daily.dev og:description: Gemma 4, Google DeepMind's latest open model family, is available for immediate deployment via vLLM and Red Hat AI Inference Server. The family spans four... og:url: https://daily.dev/posts/run-gemma-4-with-red-hat-ai-on-day-0-a-step-by-step-guide-apwfnth90 og:image: https://api.daily.dev/og/posts/aPWfnTH90.png og:image:alt: Run Gemma 4 with Red Hat AI on Day 0: A step-by-step guide og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Run Gemma 4 with Red Hat AI on Day 0: A step-by-step guide **[Red Hat Developer](https://daily.dev/sources/rhdev)** · 9 min read · 1 upvotes · 0 comments ## Summary Gemma 4, Google DeepMind's latest open model family, is available for immediate deployment via vLLM and Red Hat AI Inference Server. The family spans four models (2B to 31B parameters), all supporting multimodal input (text, image, video), with the two smallest also handling audio. The 26B A4B model uses a Mixture-of-Experts architecture, activating only 3.8B parameters per forward pass for efficient inference. All models support thinking mode, native function calling, long context windows (128K–256K tokens), and 140+ languages under Apache 2.0. The guide provides step-by-step instructions for deploying the 26B A4B model using Podman and Red Hat AI Inference Server, including examples for chat, reasoning, multimodal, and function calling via the OpenAI-compatible API. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Google’s Gemma 4 shines on local systems – both big and small](https://daily.dev/posts/google-s-gemma-4-shines-on-local-systems-both-big-and-small-qpert58dk) · InfoWorld · 0 upvotes · 0 comments - [Hacking with multimodal Gemma 4 in AI Studio](https://daily.dev/posts/hacking-with-multimodal-gemma-4-in-ai-studio-udqmc51go) · DEV · 2 upvotes · 0 comments - [Bring state-of-the-art agentic skills to the edge with Gemma 4](https://daily.dev/posts/bring-state-of-the-art-agentic-skills-to-the-edge-with-gemma-4-hucjhitib) · Google Developers · 1 upvotes · 0 comments --- Tags: [#llm](https://daily.dev/tags/llm), [#vllm](https://daily.dev/tags/vllm), [#gemma](https://daily.dev/tags/gemma), [#mixture-of-experts](https://daily.dev/tags/mixture-of-experts) [View this post on daily.dev](https://daily.dev/posts/run-gemma-4-with-red-hat-ai-on-day-0-a-step-by-step-guide-apwfnth90) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Run Gemma 4 with Red Hat AI on Day 0: A step-by-step guide","url":"https://daily.dev/posts/run-gemma-4-with-red-hat-ai-on-day-0-a-step-by-step-guide-apwfnth90","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/run-gemma-4-with-red-hat-ai-on-day-0-a-step-by-step-guide-apwfnth90"},"datePublished":"2026-04-03T13:11:04.749Z","dateModified":"2026-04-03T13:11:49.265Z","description":"Gemma 4, Google DeepMind's latest open model family, is available for immediate deployment via vLLM and Red Hat AI Inference Server. The family spans four...","image":"https://developers.redhat.com/sites/default/files/styles/share/public/Inference-vLLM-1920x1080.png?itok=x_9NzXpT","thumbnailUrl":"https://developers.redhat.com/sites/default/files/styles/share/public/Inference-vLLM-1920x1080.png?itok=x_9NzXpT","isAccessibleForFree":true,"articleSection":"Red Hat Developer","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Red Hat Developer","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/2a8895f3216c4900bdc455585a4ad3e4","url":"https://daily.dev/sources/rhdev"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/run-gemma-4-with-red-hat-ai-on-day-0-a-step-by-step-guide-apwfnth90","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"llm,vllm,gemma,mixture-of-experts","timeRequired":"PT9M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Red Hat Developer","item":"https://daily.dev/sources/rhdev"},{"@type":"ListItem","position":3,"name":"Run Gemma 4 with Red Hat AI on Day 0: A step-by-step guide"}]} ```