--- title: promptfoo/promptfoo: Test your prompts, agents, and... description: Promptfoo is an open-source CLI and library for evaluating and red-teaming LLM applications. It supports automated prompt testing, model comparison (GPT,... canonical: https://daily.dev/posts/csbitvh9c twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: promptfoo/promptfoo: Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs | daily.dev og:description: Promptfoo is an open-source CLI and library for evaluating and red-teaming LLM applications. It supports automated prompt testing, model comparison (GPT,... og:url: https://daily.dev/posts/csbitvh9c og:image: https://api.daily.dev/og/posts/csBITVH9c.png og:image:alt: Post cover image og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # promptfoo/promptfoo: Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs **[Random Resource 🧰](https://daily.dev/sources/randomresource)** · [@jobayerhossen](https://daily.dev/jobayerhossen) · 33 upvotes · 1 comments ## Summary Promptfoo is an open-source CLI and library for evaluating and red-teaming LLM applications. It supports automated prompt testing, model comparison (GPT, Claude, Gemini, Llama, etc.), vulnerability scanning, and CI/CD integration. The tool runs evaluations locally for privacy, uses declarative configs, and is now part of OpenAI while remaining MIT licensed. It claims to power LLM apps serving 10M+ users in production. ## Full article daily.dev links to this article rather than hosting it. Read it at the original source: ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 1 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments - [CNCF Unveils Schedule for KubeCon \+ CloudNativeCon Europe 2026](https://daily.dev/posts/cncf-unveils-schedule-for-kubecon-cloudnativecon-europe-2026-ikhcoa5cb) · CNCF · 2 upvotes · 0 comments - [CNCF Debuts KubeCon \+ CloudNativeCon Japan 2026 Schedule](https://daily.dev/posts/cncf-debuts-kubecon-cloudnativecon-japan-2026-schedule-xp5pyudub) · CNCF · 1 upvotes · 0 comments --- Tags: [#typescript](https://daily.dev/tags/typescript), [#cicd](https://daily.dev/tags/cicd) [View this post on daily.dev](https://daily.dev/posts/csbitvh9c) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"DiscussionForumPosting","mainEntityOfPage":"https://daily.dev/posts/csbitvh9c","headline":"promptfoo/promptfoo: Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs ","text":"Shared: promptfoo/promptfoo: Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs ","url":"https://daily.dev/posts/csbitvh9c","datePublished":"2026-04-16T11:49:26.094Z","dateModified":"2026-07-21T12:19:15.920Z","author":{"@type":"Person","name":"Jobayer Hossen","url":"https://daily.dev/jobayerhossen","image":"https://lh3.googleusercontent.com/a/ACg8ocKPWsJsesL2GMS7y3dBEvZRr7NoVelPXt3Q6EGSbMyYadlvC_s=s96-c","description":"Front-end Developer","interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"EndorseAction"},"userInteractionCount":7070}},"image":"https://media.daily.dev/image/upload/s--HRgLpUt6--/f_auto/v1722860399/public/Placeholder%2003","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":33},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":1}],"sharedContent":{"@type":"WebPage","url":"https://api.daily.dev/r/cfqyDvgFN"},"isPartOf":{"@type":"WebPage","url":"https://daily.dev/squads/randomresource","name":"Random Resource 🧰"}} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Random Resource 🧰","item":"https://daily.dev/squads/randomresource"},{"@type":"ListItem","position":3,"name":"promptfoo/promptfoo: Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs "}]} ```