--- title: Estimate GPU memory for LLM fine-tuning with Red Hat AI description: Fine-tuning LLMs requires significantly more GPU memory than inference, and launching experiments without planning can waste GPU hours. Red Hat AI's Training... canonical: https://daily.dev/posts/estimate-gpu-memory-for-llm-fine-tuning-with-red-hat-ai-jdrf6aehb twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Estimate GPU memory for LLM fine-tuning with Red Hat AI | daily.dev og:description: Fine-tuning LLMs requires significantly more GPU memory than inference, and launching experiments without planning can waste GPU hours. Red Hat AI's Training... og:url: https://daily.dev/posts/estimate-gpu-memory-for-llm-fine-tuning-with-red-hat-ai-jdrf6aehb og:image: https://api.daily.dev/og/posts/JDrf6aehB.png og:image:alt: Estimate GPU memory for LLM fine-tuning with Red Hat AI og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Estimate GPU memory for LLM fine-tuning with Red Hat AI **[Red Hat Developer](https://daily.dev/sources/rhdev)** · 10 min read · 0 upvotes · 0 comments ## Summary Fine-tuning LLMs requires significantly more GPU memory than inference, and launching experiments without planning can waste GPU hours. Red Hat AI's Training Hub (starting with OpenShift AI 3.0) includes a `memory_estimator.py` API to estimate VRAM requirements before running experiments. The post explains the memory components involved (model, gradient, optimizer, activation, output), covers how SFT, LoRA, QLoRA, and OSFT differ in memory usage, and provides strategies to reduce memory consumption. It also shows how to use the estimator classes (`BasicEstimator`, `LoRAEstimator`, `QLoRAEstimator`, `OSFTEstimator`) in Python notebooks, with example output showing per-GPU memory breakdowns and whether a given hardware setup is sufficient. Upcoming features include runtime estimation and automated hyperparameter suggestions. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Scale LLM fine-tuning with Training Hub and OpenShift AI](https://daily.dev/posts/scale-llm-fine-tuning-with-training-hub-and-openshift-ai-cxkrhxmzf) · Red Hat Developer · 0 upvotes · 0 comments - [Run LoRA fine-tuning on Red Hat OpenShift AI with Ray](https://daily.dev/posts/run-lora-fine-tuning-on-red-hat-openshift-ai-with-ray-rzynezx8q) · Red Hat Developer · 0 upvotes · 0 comments - [Unsloth and Training Hub: Lightning-fast LoRA and QLoRA fine-tuning](https://daily.dev/posts/unsloth-and-training-hub-lightning-fast-lora-and-qlora-fine-tuning-nhdohkubf) · Red Hat Developer · 1 upvotes · 0 comments --- Tags: [#lora](https://daily.dev/tags/lora), [#python](https://daily.dev/tags/python) [View this post on daily.dev](https://daily.dev/posts/estimate-gpu-memory-for-llm-fine-tuning-with-red-hat-ai-jdrf6aehb) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Estimate GPU memory for LLM fine-tuning with Red Hat AI","url":"https://daily.dev/posts/estimate-gpu-memory-for-llm-fine-tuning-with-red-hat-ai-jdrf6aehb","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/estimate-gpu-memory-for-llm-fine-tuning-with-red-hat-ai-jdrf6aehb"},"datePublished":"2026-03-04T07:44:17.667Z","dateModified":"2026-03-30T02:12:44.937Z","description":"Fine-tuning LLMs requires significantly more GPU memory than inference, and launching experiments without planning can waste GPU hours. Red Hat AI's Training...","image":"https://developers.redhat.com/sites/default/files/styles/share/public/Red-Hat-AI.png?itok=QCWQOeIo","thumbnailUrl":"https://developers.redhat.com/sites/default/files/styles/share/public/Red-Hat-AI.png?itok=QCWQOeIo","isAccessibleForFree":true,"articleSection":"Red Hat Developer","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Red Hat Developer","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/2a8895f3216c4900bdc455585a4ad3e4","url":"https://daily.dev/sources/rhdev"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/estimate-gpu-memory-for-llm-fine-tuning-with-red-hat-ai-jdrf6aehb","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"lora,python","timeRequired":"PT10M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Red Hat Developer","item":"https://daily.dev/sources/rhdev"},{"@type":"ListItem","position":3,"name":"Estimate GPU memory for LLM fine-tuning with Red Hat AI"}]} ```