--- title: "Dark Factory: OpenClaw Ships Faster Than You Can Read the Diff — Vincent Koc, Comet ML" url: https://daily.dev/posts/dark-factory-openclaw-ships-faster-than-you-can-read-the-diff-vincent-koc-comet-ml-ff6ugqhmt source_url: https://www.youtube.com/watch?v=4VhbYlfC7Gs type: video:youtube source: "AI Engineer" published: 2026-05-12T16:09:55.631Z updated: 2026-05-12T16:35:41.766Z tags: ["llm", "observability", "agentic-ai"] reading_time: 15 upvotes: 0 comments: 0 language: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Dark Factory: OpenClaw Ships Faster Than You Can Read the Diff — Vincent Koc, Comet ML **[AI Engineer](https://daily.dev/sources/aidotengineer)** · 15 min read · 0 upvotes · 0 comments ## Summary A conference talk by Vincent Koc from Comet ML arguing that traditional static AI benchmarks and evaluations are insufficient for modern agentic AI systems. He traces the evolution from prompt engineering to context engineering to 'intent engineering,' where AI systems self-optimize based on user intent. The core argument is that evals need to become adaptive and living systems rather than static datasets — using agent traces, always-on evaluation, and telemetry-in-the-loop to continuously update test suites as applications and user behavior evolve. He introduces the concept of 'eval calcification' to describe the growing gap between static benchmarks and dynamic agentic behavior, and advocates for treating evaluations as self-optimizing agents rather than fixed data points. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Agentic AI Flywheels](https://daily.dev/posts/agentic-ai-flywheels-x9mcjmgv2) · SwirlAI · 8 upvotes · 0 comments - [Shipping enterprise-quality code with AI agents](https://daily.dev/posts/shipping-enterprise-quality-code-with-ai-agents-m5aynzp2m) · InfoWorld · 0 upvotes · 0 comments --- Tags: [#llm](https://daily.dev/tags/llm), [#observability](https://daily.dev/tags/observability), [#agentic-ai](https://daily.dev/tags/agentic-ai) [View this post on daily.dev](https://daily.dev/posts/dark-factory-openclaw-ships-faster-than-you-can-read-the-diff-vincent-koc-comet-ml-ff6ugqhmt)