--- title: OSWorld: Benchmarking Multimodal Agents for Open-Ended... description: OSWorld is a scalable, real computer environment for multimodal agents that supports task setup, execution-based evaluation, and interactive learning across... canonical: https://daily.dev/posts/osworld-benchmarking-multimodal-agents-for-open-ended-tasks-in-real-computer-environments-vgj6cz6uv twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments | daily.dev og:description: OSWorld is a scalable, real computer environment for multimodal agents that supports task setup, execution-based evaluation, and interactive learning across... og:url: https://daily.dev/posts/osworld-benchmarking-multimodal-agents-for-open-ended-tasks-in-real-computer-environments-vgj6cz6uv og:image: https://api.daily.dev/og/posts/VGJ6cz6uv.png og:image:alt: OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments **[Hacker News](https://daily.dev/sources/hn)** · 1 min read · 1 upvotes · 1 comments ## Summary OSWorld is a scalable, real computer environment for multimodal agents that supports task setup, execution-based evaluation, and interactive learning across various operating systems. It serves as a unified environment for evaluating open-ended computer tasks. The benchmark on OSWorld revealed deficiencies in state-of-the-art LLM/VLM-based agents. Factors influencing the performance of VLMs in digital agent tasks include task attributes, input measurements, and UI layout. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Community discussion Top comments from developers on daily.dev. **@kartiknvj** · 0 upvotes > OSWorld exposes the gap between "works in sandbox" and "works on real OS." My agent passed the sandbox suite but failed OSWorld on window management and clipboard handling. Added those as explicit eval cases now. ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 1 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments - [CNCF Unveils Schedule for KubeCon \+ CloudNativeCon Europe 2026](https://daily.dev/posts/cncf-unveils-schedule-for-kubecon-cloudnativecon-europe-2026-ikhcoa5cb) · CNCF · 2 upvotes · 0 comments - [CNCF Debuts KubeCon \+ CloudNativeCon Japan 2026 Schedule](https://daily.dev/posts/cncf-debuts-kubecon-cloudnativecon-japan-2026-schedule-xp5pyudub) · CNCF · 1 upvotes · 0 comments --- Tags: [#ai-agents](https://daily.dev/tags/ai-agents) [View this post on daily.dev](https://daily.dev/posts/osworld-benchmarking-multimodal-agents-for-open-ended-tasks-in-real-computer-environments-vgj6cz6uv) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments","url":"https://daily.dev/posts/osworld-benchmarking-multimodal-agents-for-open-ended-tasks-in-real-computer-environments-vgj6cz6uv","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/osworld-benchmarking-multimodal-agents-for-open-ended-tasks-in-real-computer-environments-vgj6cz6uv"},"datePublished":"2024-04-28T22:40:18.682Z","dateModified":"2026-03-15T03:40:35.247Z","description":"OSWorld is a scalable, real computer environment for multimodal agents that supports task setup, execution-based evaluation, and interactive learning across...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/0a06ed391fd076b042739a3aff7d2336?_a=AQAEuiZ","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/0a06ed391fd076b042739a3aff7d2336?_a=AQAEuiZ","isAccessibleForFree":true,"articleSection":"Hacker News","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Hacker News","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/hn","url":"https://daily.dev/sources/hn"},"commentCount":1,"discussionUrl":"https://daily.dev/posts/osworld-benchmarking-multimodal-agents-for-open-ended-tasks-in-real-computer-environments-vgj6cz6uv","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":1}],"keywords":"ai-agents","timeRequired":"PT1M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Hacker News","item":"https://daily.dev/sources/hn"},{"@type":"ListItem","position":3,"name":"OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments"}]} {"@context":"https://schema.org","@type":"WebPage","@id":"https://daily.dev/posts/osworld-benchmarking-multimodal-agents-for-open-ended-tasks-in-real-computer-environments-vgj6cz6uv","comment":[{"@type":"Comment","text":"OSWorld exposes the gap between “works in sandbox” and “works on real OS.” My agent passed the sandbox suite but failed OSWorld on window management and clipboard handling. Added those as explicit eval cases now.","datePublished":"2026-09-04T22:28:38.944Z","url":"https://daily.dev/posts/VGJ6cz6uv#c-RTaRme7HR","author":{"@type":"Person","name":"kartik-nvjk","url":"https://daily.dev/kartiknvj","image":"https://media.daily.dev/image/upload/s--3gGgsVCw--/f_auto/v1781456774/avatars/avatar_TvTVeiMdkRCqWUDullFmy?_a=BAMAMiWQ0"}}]} ```