--- title: "Run Voxtral Mini 4B Realtime on vLLM with Red Hat AI on Day 1" url: https://daily.dev/posts/run-voxtral-mini-4b-realtime-on-vllm-with-red-hat-ai-on-day-1-wyohmx0fj source_url: https://developers.redhat.com/articles/2026/02/06/run-voxtral-mini-4b-realtime-vllm-red-hat-ai type: article source: "Red Hat Developer" published: 2026-02-06T19:35:54.264Z updated: 2026-02-07T03:38:43.510Z tags: ["machine-learning", "containers", "red-hat", "speech-recognition"] reading_time: 8 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Run Voxtral Mini 4B Realtime on vLLM with Red Hat AI on Day 1 **[Red Hat Developer](https://daily.dev/sources/rhdev)** · 8 min read · 0 upvotes · 0 comments ## Summary Mistral AI released Voxtral Mini 4B Realtime, a streaming automatic speech recognition model optimized for low-latency voice workloads with sub-500ms latency across 13 languages. The model is immediately supported in vLLM through its realtime streaming API and can be deployed using Red Hat AI Inference Server. The guide provides step-by-step instructions for deploying Voxtral using containerized infrastructure with GPU acceleration, including prerequisites, container setup, and a Python client for testing streaming transcription via WebSocket endpoints. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Voxtral-Mini-4B-Realtime for real-time speech transcription is now available in Amazon SageMaker JumpStart](https://daily.dev/posts/voxtral-mini-4b-realtime-for-real-time-speech-transcription-is-now-available-in-amazon-sagemaker-jum-y4vpyj230) · AWS · 0 upvotes · 0 comments - [Run Mistral Large 3 & Ministral 3 on vLLM with Red Hat AI on Day 0](https://daily.dev/posts/run-mistral-large-3-ministral-3-on-vllm-with-red-hat-ai-on-day-0-q15kf6wpd) · Red Hat Developer · 1 upvotes · 0 comments - [Deploy Mistral AI’s Voxtral on Amazon SageMaker AI](https://daily.dev/posts/deploy-mistral-ai-s-voxtral-on-amazon-sagemaker-ai-0coeqj5xe) · AWS · 0 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#containers](https://daily.dev/tags/containers), [#red-hat](https://daily.dev/tags/red-hat), [#speech-recognition](https://daily.dev/tags/speech-recognition) [View this post on daily.dev](https://daily.dev/posts/run-voxtral-mini-4b-realtime-on-vllm-with-red-hat-ai-on-day-1-wyohmx0fj)