--- title: "Creating the NVIDIA Nemotron 3 Ultra NVFP4 Checkpoint with NVIDIA Model Optimizer" url: https://daily.dev/posts/creating-the-nvidia-nemotron-3-ultra-nvfp4-checkpoint-with-nvidia-model-optimizer-o6e6ls0pg source_url: https://developer.nvidia.com/blog/creating-the-nvidia-nemotron-3-ultra-nvfp4-checkpoint-with-nvidia-model-optimizer type: article source: "NVIDIA Developer" published: 2026-06-26T16:05:12.566Z updated: 2026-06-26T16:05:36.924Z tags: ["data-science", "llm"] reading_time: 16 upvotes: 1 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Creating the NVIDIA Nemotron 3 Ultra NVFP4 Checkpoint with NVIDIA Model Optimizer **[NVIDIA Developer](https://daily.dev/sources/nvidiadev)** · 16 min read · 1 upvotes · 0 comments ## Summary A deep dive into how NVIDIA quantized the 550B Nemotron 3 Ultra model to NVFP4 using NVIDIA Model Optimizer. The post explains why different layers use different precision formats (NVFP4, FP8, BF16), compares quantization scaling strategies including max scaling, MSE scaling, and the novel four-over-six approach, and shows how bits-per-element sweeps identified 5.03 BPE as the accuracy-performance sweet spot. The result is a 3.2x model size reduction (1,121 GB to 352.3 GB) with near-BF16 accuracy and up to 5.9x higher inference throughput. Practical code examples and YAML recipes for reproducing the pipeline with any Hugging Face model are included, along with a comparison of HuggingFace Transformers vs. Megatron-LM quantization paths (120 min vs. 45 min total). ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Using NVFP4 Low-Precision Model Training for Higher Throughput Without Losing Accuracy](https://daily.dev/posts/using-nvfp4-low-precision-model-training-for-higher-throughput-without-losing-accuracy-mburtmoay) · NVIDIA Developer · 1 upvotes · 0 comments --- Tags: [#data-science](https://daily.dev/tags/data-science), [#llm](https://daily.dev/tags/llm) [View this post on daily.dev](https://daily.dev/posts/creating-the-nvidia-nemotron-3-ultra-nvfp4-checkpoint-with-nvidia-model-optimizer-o6e6ls0pg)