--- title: AI agents create virtual playgrounds to help robots get... description: MIT CSAIL and Toyota Research Institute researchers developed SceneSmith, a system that uses three AI agents powered by GPT-5.2 to automatically generate... canonical: https://daily.dev/posts/ai-agents-create-virtual-playgrounds-to-help-robots-get-crucial-training-data-paryx7xxz twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: AI agents create virtual playgrounds to help robots get crucial training data | daily.dev og:description: MIT CSAIL and Toyota Research Institute researchers developed SceneSmith, a system that uses three AI agents powered by GPT-5.2 to automatically generate... og:url: https://daily.dev/posts/ai-agents-create-virtual-playgrounds-to-help-robots-get-crucial-training-data-paryx7xxz og:image: https://api.daily.dev/og/posts/PaRYx7xXz.png og:image:alt: AI agents create virtual playgrounds to help robots get crucial training data og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # AI agents create virtual playgrounds to help robots get crucial training data **[Robohub](https://daily.dev/sources/robohub)** · 7 min read · 0 upvotes · 0 comments ## Summary MIT CSAIL and Toyota Research Institute researchers developed SceneSmith, a system that uses three AI agents powered by GPT-5.2 to automatically generate realistic 3D indoor environments for robot training. A 'designer' agent creates scene layouts, a 'critic' evaluates realism, and an 'orchestrator' manages the process. The system produces scenes with up to six times more objects than prior methods, including articulated items like cabinets. Over 200 users found SceneSmith's visuals more realistic than competing systems over 90% of the time, and a pretrained robot policy successfully executed tasks in generated scenes without prior exposure to them. The main trade-off is speed — generating a single scene can take multiple hours. The work was presented as a spotlight at the 2026 International Conference on Machine Learning. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### How does the MIT SceneSmith system generate 3D scenes for robot training? SceneSmith uses three VLM agents built on GPT-5.2: a 'designer' that generates scene layouts and objects, a 'critic' that evaluates realism and flags issues (e.g., removing a bathtub from a living room), and an 'orchestrator' that manages their back-and-forth and decides when the design is complete. The finished scene loads directly into physics simulation software with properties like mass, friction, and inertia. _Robotics engineers tracking simulation tooling for training pipelines follow developments like SceneSmith on daily.dev._ ### How does SceneSmith compare to other 3D scene generation baselines like Holodeck? SceneSmith outperforms baselines including HSM and Holodeck by generating environments with up to six times more objects per scene, including articulated items like openable cabinets that prior baselines rarely included. Over 200 users rated SceneSmith's visuals as more realistic more than 90% of the time and found it followed prompts more closely than competing approaches. _Teams deciding between scene-generation tools for robot sim environments track comparisons like this on daily.dev._ ## Similar posts on daily.dev - [Using generative AI to diversify virtual training grounds for robots](https://daily.dev/posts/using-generative-ai-to-diversify-virtual-training-grounds-for-robots-atuqskcr5) · Robohub · 0 upvotes · 0 comments - [World Models: The Quiet Race to Build AI That Understands Reality, Not Just Language](https://daily.dev/posts/world-models-the-quiet-race-to-build-ai-that-understands-reality-not-just-language-2pfjhmqhl) · Medium · 0 upvotes · 0 comments - [Roblox debuts tool for players to AI-generate interactive in-game objects, promises "full scene generation" is coming](https://daily.dev/posts/roblox-debuts-tool-for-players-to-ai-generate-interactive-in-game-objects-promises-full-scene-gene-vx3drzrqv) · GamesIndustry.biz · 0 upvotes · 0 comments --- Tags: [#ai-agents](https://daily.dev/tags/ai-agents), [#robotics](https://daily.dev/tags/robotics), [#vlm](https://daily.dev/tags/vlm) [View this post on daily.dev](https://daily.dev/posts/ai-agents-create-virtual-playgrounds-to-help-robots-get-crucial-training-data-paryx7xxz) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"AI agents create virtual playgrounds to help robots get crucial training data","url":"https://daily.dev/posts/ai-agents-create-virtual-playgrounds-to-help-robots-get-crucial-training-data-paryx7xxz","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/ai-agents-create-virtual-playgrounds-to-help-robots-get-crucial-training-data-paryx7xxz"},"datePublished":"2026-08-07T07:23:23.955Z","dateModified":"2026-08-07T07:23:55.574Z","description":"MIT CSAIL and Toyota Research Institute researchers developed SceneSmith, a system that uses three AI agents powered by GPT-5.2 to automatically generate...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/baea1207d0a6414d7195eae1475c5e31?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/baea1207d0a6414d7195eae1475c5e31?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Robohub","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Robohub","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/79911e4f3a514623a70a98793133f536","url":"https://daily.dev/sources/robohub"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/ai-agents-create-virtual-playgrounds-to-help-robots-get-crucial-training-data-paryx7xxz","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"ai-agents,robotics,vlm","timeRequired":"PT7M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Robohub","item":"https://daily.dev/sources/robohub"},{"@type":"ListItem","position":3,"name":"AI agents create virtual playgrounds to help robots get crucial training data"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/ai-agents-create-virtual-playgrounds-to-help-robots-get-crucial-training-data-paryx7xxz#faq","mainEntity":[{"@type":"Question","name":"How does the MIT SceneSmith system generate 3D scenes for robot training?","acceptedAnswer":{"@type":"Answer","text":"SceneSmith uses three VLM agents built on GPT-5.2: a 'designer' that generates scene layouts and objects, a 'critic' that evaluates realism and flags issues (e.g., removing a bathtub from a living room), and an 'orchestrator' that manages their back-and-forth and decides when the design is complete. The finished scene loads directly into physics simulation software with properties like mass, friction, and inertia. Robotics engineers tracking simulation tooling for training pipelines follow developments like SceneSmith on daily.dev."}},{"@type":"Question","name":"How does SceneSmith compare to other 3D scene generation baselines like Holodeck?","acceptedAnswer":{"@type":"Answer","text":"SceneSmith outperforms baselines including HSM and Holodeck by generating environments with up to six times more objects per scene, including articulated items like openable cabinets that prior baselines rarely included. Over 200 users rated SceneSmith's visuals as more realistic more than 90% of the time and found it followed prompts more closely than competing approaches. Teams deciding between scene-generation tools for robot sim environments track comparisons like this on daily.dev."}}]} ```