---
title: "Shipping custom models at scale from fine-tuning to inference | BRK234"
url: https://daily.dev/posts/shipping-custom-models-at-scale-from-fine-tuning-to-inference-brk234-k9dlvakih
source_url: https://www.youtube.com/watch?v=StIDwTzcE_w
type: video:youtube
source: "Microsoft Developer"
published: 2026-06-04T12:38:30.851Z
updated: 2026-06-04T12:38:52.482Z
tags: ["deep-learning", "pytorch", "reinforcement-learning", "lora"]
reading_time: 46
upvotes: 0
comments: 0
language: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Shipping custom models at scale from fine-tuning to inference | BRK234

**[Microsoft Developer](https://daily.dev/sources/microsoftdeveloper)** · 46 min read · 0 upvotes · 0 comments

## Summary

A panel discussion from Microsoft Build featuring experts from Fireworks AI, Unsloth, and Core Automation covering the full stack of custom model deployment — from RL post-training to inference optimization. Key topics include: how GRPO/RL training differs from supervised fine-tuning and why it strains memory (dual inference+training engines), LoRA as a memory-efficient fine-tuning approach (even rank-1 works surprisingly well), gradient checkpointing mechanics, GPU kernel optimization techniques (fusion, CUDA graphs, torch.compile flags), speculative decoding trade-offs for agentic workloads, reward function design challenges and reward hacking, and the emerging role of AI in automating GPU kernel generation. Practical advice includes reading the torch inductor config file, doing math/algorithms before kernel work, and understanding that 80% of managed inference value comes from fusion plus CUDA graphs.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://www.youtube.com/watch?v=StIDwTzcE_w>

## Similar posts on daily.dev

- [Fine-tuning is no longer just an AI research process. It’s becoming a developer workflow.](https://daily.dev/posts/fine-tuning-is-no-longer-just-an-ai-research-process-it-s-becoming-a-developer-workflow--6t1efefmf) · All Things Open · 0 upvotes · 0 comments

---

Tags: [#deep-learning](https://daily.dev/tags/deep-learning), [#pytorch](https://daily.dev/tags/pytorch), [#reinforcement-learning](https://daily.dev/tags/reinforcement-learning), [#lora](https://daily.dev/tags/lora)

[View this post on daily.dev](https://daily.dev/posts/shipping-custom-models-at-scale-from-fine-tuning-to-inference-brk234-k9dlvakih)