--- title: Testing Datadog's Next-Generation Event Platform Intake... description: Datadog's EVP Intake team describes using Antithesis to test a major architectural shift in their event pipeline, moving from stateless to stateful... canonical: https://daily.dev/posts/testing-datadog-s-next-generation-event-platform-intake-with-antithesis-k38c46afb twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Testing Datadog's Next-Generation Event Platform Intake with Antithesis | daily.dev og:description: Datadog's EVP Intake team describes using Antithesis to test a major architectural shift in their event pipeline, moving from stateless to stateful... og:url: https://daily.dev/posts/testing-datadog-s-next-generation-event-platform-intake-with-antithesis-k38c46afb og:image: https://api.daily.dev/og/posts/k38c46Afb.png og:image:alt: Testing Datadog's Next-Generation Event Platform Intake with Antithesis og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Testing Datadog's Next-Generation Event Platform Intake with Antithesis **[Antithesis](https://daily.dev/sources/antithesis)** · 7 min read · 0 upvotes · 0 comments ## Summary Datadog's EVP Intake team describes using Antithesis to test a major architectural shift in their event pipeline, moving from stateless to stateful communication between the Datadog Agent and Intake to reduce transmitted data volume. Engineers Joy Zhang and Michele Zoncheddu explain how Antithesis surfaced JVM crashes, protocol-breaking bugs, and a durability invariant violation in existing production code during a proof-of-concept phase. The team shifted toward invariant-first design, writing correctness properties before implementation, and used an antithesis-research agent to check invariants against production code. The stateful encoding project has since moved from POC into a pilot on the metrics pipeline, part of Datadog's broader 'harness-first engineering' approach to combining AI coding agents with rigorous validation. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Questions this post answers ### What testing challenges come up when moving a production system from stateless to stateful communication? Maintaining stateful synchronization across proxies, with network delays and failures, is extremely tricky, especially for load-bearing, mature production services. Datadog's EVP Intake team found that Antithesis could exercise complex timing interleavings and reproduce protocol-breaking bugs and JVM crashes that were difficult to trigger with existing tests during their stateless-to-stateful migration. _Teams navigating similar stateful protocol migrations can find engineering write-ups like this on daily.dev._ ### What is invariant-first design and how are teams applying it with AI coding agents? Invariant-first design means writing down correctness invariants before implementation code, then validating that both new and existing systems uphold them. Datadog engineer Michele Zoncheddu used this approach while building an on-disk buffer library, pointing an antithesis-research agent at production code with the new design and invariants, which found a durability violation within a couple hours on the ordinary code path. _Developers combining invariant-based testing with AI agents can track approaches like this on daily.dev._ ## Similar posts on daily.dev - [Architects, testers, and coders: Building multi-agent development teams](https://daily.dev/posts/architects-testers-and-coders-building-multi-agent-development-teams-xgqgzpcsv) · Flutter · 4 upvotes · 0 comments - [Build Compliant AI Agents With Stateful Stream Processing](https://daily.dev/posts/build-compliant-ai-agents-with-stateful-stream-processing-8j9jpvuul) · Confluent Blog · 2 upvotes · 0 comments - [Cost-effective gen AI workflows in Google Dataflow](https://daily.dev/posts/cost-effective-gen-ai-workflows-in-google-dataflow-xdtedmn7h) · Google Cloud · 0 upvotes · 0 comments - [New Recording on Event modelling anti-patterns from DDDEU](https://daily.dev/posts/new-recording-on-event-modelling-anti-patterns-from-dddeu-9kvya7l9m) · Architecture Weekly · 1 upvotes · 0 comments --- Tags: [#devops](https://daily.dev/tags/devops), [#observability](https://daily.dev/tags/observability) [View this post on daily.dev](https://daily.dev/posts/testing-datadog-s-next-generation-event-platform-intake-with-antithesis-k38c46afb) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Testing Datadog's Next-Generation Event Platform Intake with Antithesis","url":"https://daily.dev/posts/testing-datadog-s-next-generation-event-platform-intake-with-antithesis-k38c46afb","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/testing-datadog-s-next-generation-event-platform-intake-with-antithesis-k38c46afb"},"datePublished":"2026-09-29T14:54:50.797Z","dateModified":"2026-09-29T19:39:19.478Z","description":"Datadog's EVP Intake team describes using Antithesis to test a major architectural shift in their event pipeline, moving from stateless to stateful...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/f436e49744e19c5fa736b515e54f0031?_a=AQAEuop","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/f436e49744e19c5fa736b515e54f0031?_a=AQAEuop","isAccessibleForFree":true,"articleSection":"Antithesis","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Antithesis","logo":"https://media.daily.dev/image/upload/s--17qPGZ9J--/f_auto,q_auto/v1788684980/logos/antithesis?_a=BAMAMicg0","url":"https://daily.dev/sources/antithesis"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/testing-datadog-s-next-generation-event-platform-intake-with-antithesis-k38c46afb","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":0},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"devops,observability","timeRequired":"PT7M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Antithesis","item":"https://daily.dev/sources/antithesis"},{"@type":"ListItem","position":3,"name":"Testing Datadog's Next-Generation Event Platform Intake with Antithesis"}]} {"@context":"https://schema.org","@type":"FAQPage","@id":"https://daily.dev/posts/testing-datadog-s-next-generation-event-platform-intake-with-antithesis-k38c46afb#faq","mainEntity":[{"@type":"Question","name":"What testing challenges come up when moving a production system from stateless to stateful communication?","acceptedAnswer":{"@type":"Answer","text":"Maintaining stateful synchronization across proxies, with network delays and failures, is extremely tricky, especially for load-bearing, mature production services. Datadog's EVP Intake team found that Antithesis could exercise complex timing interleavings and reproduce protocol-breaking bugs and JVM crashes that were difficult to trigger with existing tests during their stateless-to-stateful migration. Teams navigating similar stateful protocol migrations can find engineering write-ups like this on daily.dev."}},{"@type":"Question","name":"What is invariant-first design and how are teams applying it with AI coding agents?","acceptedAnswer":{"@type":"Answer","text":"Invariant-first design means writing down correctness invariants before implementation code, then validating that both new and existing systems uphold them. Datadog engineer Michele Zoncheddu used this approach while building an on-disk buffer library, pointing an antithesis-research agent at production code with the new design and invariants, which found a durability violation within a couple hours on the ordinary code path. Developers combining invariant-based testing with AI agents can track approaches like this on daily.dev."}}]} ```