---
title: "RUN AI MODELS ON k8s! #ai #llm"
url: https://daily.dev/posts/run-ai-models-on-k8s-ai-llm-xaroqezpv
source_url: https://www.youtube.com/watch?v=_HlwEc8rdhg
type: video:youtube
source: "That DevOps Guy"
published: 2026-05-31T07:40:53.622Z
updated: 2026-05-31T07:52:26.910Z
tags: ["kubernetes", "llm", "llama-cpp"]
reading_time: 2
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# RUN AI MODELS ON k8s! #ai #llm

**[That DevOps Guy](https://daily.dev/sources/marcel-dempers)** · 2 min read · 0 upvotes · 0 comments

## Summary

LLM Cube is a Kubernetes operator that enables running production-grade language models on your own hardware. Using YAML definitions, you can specify models (e.g., Gemma 4 2B from Hugging Face), quantization settings, hardware requirements, and inference runtimes like llama.cpp. LLM Cube handles pod scheduling, model downloading to persistent volumes, and exposes an OpenAI-compatible endpoint — all manageable via standard kubectl commands.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://www.youtube.com/watch?v=_HlwEc8rdhg>

## Similar posts on daily.dev

- [Open-weight AI on Kubernetes: A Developer’s Guide to vLLM vs. KubeAI](https://daily.dev/posts/open-weight-ai-on-kubernetes-a-developer-s-guide-to-vllm-vs-kubeai-hdxk8ddoh) · SitePoint · 0 upvotes · 0 comments

---

Tags: [#kubernetes](https://daily.dev/tags/kubernetes), [#llm](https://daily.dev/tags/llm), [#llama-cpp](https://daily.dev/tags/llama-cpp)

[View this post on daily.dev](https://daily.dev/posts/run-ai-models-on-k8s-ai-llm-xaroqezpv)