--- title: RamaLama: Making working with AI Models Boring by Cedric... description: RamaLama is a Red Hat open source project that uses containers (Podman or Docker) to run open source LLMs locally and in production environments like... canonical: https://daily.dev/posts/ramalama-making-working-with-ai-models-boring-by-cedric-clyburn-78etteano twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: RamaLama: Making working with AI Models Boring by Cedric Clyburn | daily.dev og:description: RamaLama is a Red Hat open source project that uses containers (Podman or Docker) to run open source LLMs locally and in production environments like... og:url: https://daily.dev/posts/ramalama-making-working-with-ai-models-boring-by-cedric-clyburn-78etteano og:image: https://api.daily.dev/og/posts/78ETTEano.png og:image:alt: RamaLama: Making working with AI Models Boring by Cedric Clyburn og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # RamaLama: Making working with AI Models Boring by Cedric Clyburn **[Devoxx](https://daily.dev/sources/devoxx)** · 47 min read · 0 upvotes · 0 comments ## Summary RamaLama is a Red Hat open source project that uses containers (Podman or Docker) to run open source LLMs locally and in production environments like Kubernetes. The talk covers running models via llama.cpp or vLLM inference engines, benchmarking local model performance, containerizing AI workloads with security isolation flags, building RAG pipelines using Dockling for document ingestion and vector databases, generating systemd Quadlets and Kubernetes YAML manifests for deployment, and building agentic AI applications with LangChain4j. The core idea is solving the 'works on my machine' problem for AI by treating models as versioned container artifacts that move consistently from laptop to cluster. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Deploy vision language models with RamaLama](https://daily.dev/posts/deploy-vision-language-models-with-ramalama-ceqfubllr) · Red Hat Developer · 0 upvotes · 0 comments - [llama-farm/llamafarm: Deploy any AI model, agents, database, RAG, and pipeline locally in minutes](https://daily.dev/posts/llama-farm-llamafarm-deploy-any-ai-model-agents-database-rag-and-pipeline-locally-in-minutes-dplv4kag5) · Hacker News · 0 upvotes · 0 comments - [How to run OpenAI's gpt-oss models locally with RamaLama](https://daily.dev/posts/how-to-run-openai-s-gpt-oss-models-locally-with-ramalama-bpaq6snps) · Red Hat Developer · 0 upvotes · 0 comments --- Tags: [#containers](https://daily.dev/tags/containers), [#llama-cpp](https://daily.dev/tags/llama-cpp), [#local-ai](https://daily.dev/tags/local-ai), [#rag](https://daily.dev/tags/rag) [View this post on daily.dev](https://daily.dev/posts/ramalama-making-working-with-ai-models-boring-by-cedric-clyburn-78etteano) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"RamaLama: Making working with AI Models Boring by Cedric Clyburn","url":"https://daily.dev/posts/ramalama-making-working-with-ai-models-boring-by-cedric-clyburn-78etteano","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/ramalama-making-working-with-ai-models-boring-by-cedric-clyburn-78etteano"},"datePublished":"2026-03-30T17:48:25.327Z","dateModified":"2026-05-14T02:12:28.161Z","description":"RamaLama is a Red Hat open source project that uses containers (Podman or Docker) to run open source LLMs locally and in production environments like...","image":"https://i.ytimg.com/vi/CYxwXobrL28/sddefault.jpg","thumbnailUrl":"https://i.ytimg.com/vi/CYxwXobrL28/sddefault.jpg","isAccessibleForFree":true,"articleSection":"Devoxx","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Devoxx","logo":"https://media.daily.dev/image/upload/s--6vG797wn--/f_auto,q_auto/v1773648800/logos/devoxx?_a=BAMAMiiu0","url":"https://daily.dev/sources/devoxx"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/ramalama-making-working-with-ai-models-boring-by-cedric-clyburn-78etteano","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"containers,llama-cpp,local-ai,rag","timeRequired":"PT47M","video":{"@type":"VideoObject","name":"RamaLama: Making working with AI Models Boring by Cedric Clyburn","description":"RamaLama is a Red Hat open source project that uses containers (Podman or Docker) to run open source LLMs locally and in production environments like...","thumbnailUrl":"https://i.ytimg.com/vi/CYxwXobrL28/sddefault.jpg","uploadDate":"2026-03-30T17:48:25.327Z","duration":"PT47M","url":"https://api.daily.dev/r/78ETTEano","embedUrl":"https://www.youtube.com/embed/CYxwXobrL28"}} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Devoxx","item":"https://daily.dev/sources/devoxx"},{"@type":"ListItem","position":3,"name":"RamaLama: Making working with AI Models Boring by Cedric Clyburn"}]} ```