A walkthrough of deploying a NanoChat language model trained with Dagster to a RunPod serverless inference endpoint. Covers packaging the model into a Docker image with a serverless handler function (similar to AWS Lambda), creating RunPod templates and endpoints via a custom Dagster resource, and representing the endpoint as a Dagster asset for lineage tracking. Also shows how to build a chat inference asset that sends prompts to the live endpoint and stores results in Dagster's execution history, completing an end-to-end pipeline from raw data ingestion to interactive model serving.

6m read timeFrom dagster.io
Post cover image
Table of contents
Packaging the Model for DeploymentWriting the Serverless HandlerCreating the Serverless EndpointInteracting With the Model Through a Chat AssetWrapping Up the Journey
4 Impressions