--- title: NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to... description: NVIDIA released Cosmos3-H-Dreams, a real-time generative simulator trained on clinical cholecystectomy video and robot kinematics from the CMR Surgical Versius... canonical: https://daily.dev/posts/nvidia-cosmos3-h-dreams-bringing-clinical-surgery-to-life-through-generative-simulation-mamxiwqwt twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation | daily.dev og:description: NVIDIA released Cosmos3-H-Dreams, a real-time generative simulator trained on clinical cholecystectomy video and robot kinematics from the CMR Surgical Versius... og:url: https://daily.dev/posts/nvidia-cosmos3-h-dreams-bringing-clinical-surgery-to-life-through-generative-simulation-mamxiwqwt og:image: https://api.daily.dev/og/posts/MAmxIwQWt.png og:image:alt: NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation **[Hugging Face](https://daily.dev/sources/huggingface)** · 6 min read · 0 upvotes · 0 comments ## Summary NVIDIA released Cosmos3-H-Dreams, a real-time generative simulator trained on clinical cholecystectomy video and robot kinematics from the CMR Surgical Versius platform. It builds on the 16-billion-parameter Cosmos3-H-Embodied-Nano model and uses 28 action dimensions covering pose and gripper for both arms, plus energy controls and thumbstick inputs. Training used 832x480 video at 10 Hz, distilled into four-step and two-step student checkpoints for faster inference. Accelerated by NVIDIA's FlashDreams streaming library, it runs interactively on a single RTX PRO 6000 GPU. NVIDIA calls it a research simulator, not a validated system for patient care. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What is NVIDIA Cosmos3-H-Dreams and what does it simulate? Cosmos3-H-Dreams is a real-time generative world model that simulates clinical cholecystectomy surgery, trained on video and robot kinematics from the CMR Surgical Versius platform. It is described as the first real-time generative surgical simulator trained on clinical cholecystectomy recordings to support live kinematic control, built on the 16-billion-parameter Cosmos3-H-Embodied-Nano model. _Explore how daily.dev surfaces generative simulation and robotics research like this as it ships._ ### What hardware do I need to run Cosmos3-H-Dreams interactively? A single NVIDIA RTX PRO 6000 GPU is enough to run it interactively. The model is accelerated with FlashDreams, NVIDIA's streaming-inference library, and uses distilled four-step or two-step denoising checkpoints that trade visual quality for lower inference cost during live control. _Developers sizing GPU budgets for generative simulation workloads can track releases like this on daily.dev._ ### How many denoising steps does the Cosmos3-H-Dreams student model use for real-time generation? Two checkpoints are released: a four-step student and a separately trained two-step student, each generating video in short blocks as new actions arrive. Fewer denoising steps gives faster inference at the cost of lower visual quality, letting developers balance quality against latency for their own use case. _Anyone weighing inference speed against output quality in diffusion-style models can follow updates like this on daily.dev._ ## Similar posts on daily.dev - [NVIDIA Cosmos-H-Dreams: Bringing Real-Time Generative Simulation to Surgical Robotics](https://daily.dev/posts/nvidia-cosmos-h-dreams-bringing-real-time-generative-simulation-to-surgical-robotics-9r3gghrgf) · Hugging Face · 0 upvotes · 0 comments - [Build World Models for Interactive Simulation with NVIDIA Cosmos](https://daily.dev/posts/build-world-models-for-interactive-simulation-with-nvidia-cosmos-ba6dexget) · NVIDIA Developer · 0 upvotes · 0 comments - [The Rise of Physical AI for Healthcare Robotics](https://daily.dev/posts/the-rise-of-physical-ai-for-healthcare-robotics-qyfl9vmus) · Hugging Face · 0 upvotes · 0 comments - [NVIDIA Cosmos Opens New Tools to Train, Evaluate and Deploy World Models](https://daily.dev/posts/nvidia-cosmos-opens-new-tools-to-train-evaluate-and-deploy-world-models-i61wzilhw) · NVIDIA · 0 upvotes · 0 comments --- Tags: [#machine-learning](https://daily.dev/tags/machine-learning), [#healthcare](https://daily.dev/tags/healthcare) [View this post on daily.dev](https://daily.dev/posts/nvidia-cosmos3-h-dreams-bringing-clinical-surgery-to-life-through-generative-simulation-mamxiwqwt) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation","url":"https://daily.dev/posts/nvidia-cosmos3-h-dreams-bringing-clinical-surgery-to-life-through-generative-simulation-mamxiwqwt","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/nvidia-cosmos3-h-dreams-bringing-clinical-surgery-to-life-through-generative-simulation-mamxiwqwt"},"datePublished":"2026-10-20T18:22:01.839Z","dateModified":"2026-10-20T18:38:44.362Z","description":"NVIDIA released Cosmos3-H-Dreams, a real-time generative simulator trained on clinical cholecystectomy video and robot kinematics from the CMR Surgical Versius...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/9c49826b19526e8d9bd9c8a7e60c380b?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/9c49826b19526e8d9bd9c8a7e60c380b?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Hugging Face","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Hugging Face","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/f1f55c67d81a4330acf5b90b26b0c8e1","url":"https://daily.dev/sources/huggingface"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/nvidia-cosmos3-h-dreams-bringing-clinical-surgery-to-life-through-generative-simulation-mamxiwqwt","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"machine-learning,healthcare","timeRequired":"PT6M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Hugging Face","item":"https://daily.dev/sources/huggingface"},{"@type":"ListItem","position":3,"name":"NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/nvidia-cosmos3-h-dreams-bringing-clinical-surgery-to-life-through-generative-simulation-mamxiwqwt#faq","mainEntity":[{"@type":"Question","name":"What is NVIDIA Cosmos3-H-Dreams and what does it simulate?","acceptedAnswer":{"@type":"Answer","text":"Cosmos3-H-Dreams is a real-time generative world model that simulates clinical cholecystectomy surgery, trained on video and robot kinematics from the CMR Surgical Versius platform. It is described as the first real-time generative surgical simulator trained on clinical cholecystectomy recordings to support live kinematic control, built on the 16-billion-parameter Cosmos3-H-Embodied-Nano model. Explore how daily.dev surfaces generative simulation and robotics research like this as it ships."}},{"@type":"Question","name":"What hardware do I need to run Cosmos3-H-Dreams interactively?","acceptedAnswer":{"@type":"Answer","text":"A single NVIDIA RTX PRO 6000 GPU is enough to run it interactively. The model is accelerated with FlashDreams, NVIDIA's streaming-inference library, and uses distilled four-step or two-step denoising checkpoints that trade visual quality for lower inference cost during live control. Developers sizing GPU budgets for generative simulation workloads can track releases like this on daily.dev."}},{"@type":"Question","name":"How many denoising steps does the Cosmos3-H-Dreams student model use for real-time generation?","acceptedAnswer":{"@type":"Answer","text":"Two checkpoints are released: a four-step student and a separately trained two-step student, each generating video in short blocks as new actions arrive. Fewer denoising steps gives faster inference at the cost of lower visual quality, letting developers balance quality against latency for their own use case. Anyone weighing inference speed against output quality in diffusion-style models can follow updates like this on daily.dev."}}]} ```