--- title: Iterating Towards LLM Reliability with Evaluation Driven... description: This post discusses the challenges of building reliable LLM products and how Dosu uses evaluation driven development (EDD) to iterate and improve its product.... canonical: https://daily.dev/posts/iterating-towards-llm-reliability-with-evaluation-driven-development-cjojj1m4w twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Iterating Towards LLM Reliability with Evaluation Driven Development | daily.dev og:description: This post discusses the challenges of building reliable LLM products and how Dosu uses evaluation driven development (EDD) to iterate and improve its product.... og:url: https://daily.dev/posts/iterating-towards-llm-reliability-with-evaluation-driven-development-cjojj1m4w og:image: https://api.daily.dev/og/posts/CJoJj1m4w.png og:image:alt: Iterating Towards LLM Reliability with Evaluation Driven Development og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Iterating Towards LLM Reliability with Evaluation Driven Development **[LangChain](https://daily.dev/sources/langchain)** · 6 min read · 4 upvotes · 0 comments ## Summary This post discusses the challenges of building reliable LLM products and how Dosu uses evaluation driven development (EDD) to iterate and improve its product. It also highlights the upgrade of Dosu's LLM monitoring stack with LangSmith and the benefits it provides. The post mentions the use of LangSmith's SDK, finding failure modes, and automating evaluation dataset collection. Dosu is hiring. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 1 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments --- Tags: [#langsmith](https://daily.dev/tags/langsmith), [#llm](https://daily.dev/tags/llm), [#monitoring](https://daily.dev/tags/monitoring) [View this post on daily.dev](https://daily.dev/posts/iterating-towards-llm-reliability-with-evaluation-driven-development-cjojj1m4w) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Iterating Towards LLM Reliability with Evaluation Driven Development","url":"https://daily.dev/posts/iterating-towards-llm-reliability-with-evaluation-driven-development-cjojj1m4w","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/iterating-towards-llm-reliability-with-evaluation-driven-development-cjojj1m4w"},"datePublished":"2024-03-11T15:13:58.992Z","dateModified":"2026-06-04T02:16:30.423Z","description":"This post discusses the challenges of building reliable LLM products and how Dosu uses evaluation driven development (EDD) to iterate and improve its product....","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/af51431cde37d5e1edda030e43b91df3?_a=AQAEufR","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/af51431cde37d5e1edda030e43b91df3?_a=AQAEufR","isAccessibleForFree":true,"articleSection":"LangChain","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"LangChain","logo":"https://media.daily.dev/image/upload/t_logo,f_auto/v1/logos/0f4f2629e0724a849823f8cd0d913e13","url":"https://daily.dev/sources/langchain"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/iterating-towards-llm-reliability-with-evaluation-driven-development-cjojj1m4w","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":4},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"langsmith,llm,monitoring","timeRequired":"PT6M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"LangChain","item":"https://daily.dev/sources/langchain"},{"@type":"ListItem","position":3,"name":"Iterating Towards LLM Reliability with Evaluation Driven Development"}]} ```