Daily Dose of Data Science | Avi Chawla | Substack
Read post

6 LLM Deployment Formats in Production

A visual breakdown of six LLM deployment formats used in production: Pickle, Safetensors, GGUF, ONNX, MLX, and TensorRT. Each format trades portability for performance — raw weight formats like Pickle and Safetensors run anywhere Python runs, GGUF bundles everything for framework-free execution, ONNX enables cross-framework portability, MLX is optimized for Apple Silicon's unified memory, and TensorRT compiles to machine code for a specific NVIDIA GPU. The general rule: the more hardware-specific the format, the faster it runs but the fewer machines can use it. The newsletter also covers data leakage in ML pipelines, including common causes (train/test contamination, preprocessing leakage, target-derived features) and prevention strategies.

    #machine-learning#llmops
Jul 29•6m read time•From blog.dailydoseofds.com
Post cover image
Table of contents
Your agents are doing web search wrong6 LLM deployment formats in production​ Prevent data leakage in ML pipelines ​
2.1K Impressions
Daily Dose of Data Science | Avi Chawla | Substack's image
Daily Dose of Data Science | Avi Chawla | Substack

Daily Dose of DS offers a daily dose of inspiration, education, and motivation for data scientists a...

1.2K Followers

•

12.8K Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard