<!-- mobian-agent-page publisher="dailydev" canonical="https://daily.dev/posts/3opeen2ys" -->

---
title: GitHub - NVIDIA/SkillEvaluator: Multi-tier framework for...
description: SkillEvaluator is an NVIDIA framework for checking AI agent skills and measuring their effect on task outcomes. It runs quality checks first, then compares...
canonical: https://daily.dev/posts/3opeen2ys
twitter:card: summary_large_image
twitter:site: @dailydotdev
og:type: website
og:site_name: daily.dev
og:title: GitHub - NVIDIA/SkillEvaluator: Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation t | daily.dev
og:description: SkillEvaluator is an NVIDIA framework for checking AI agent skills and measuring their effect on task outcomes. It runs quality checks first, then compares...
og:url: https://daily.dev/posts/3opeen2ys
og:image: https://api.daily.dev/og/posts/3Opeen2YS.png
og:image:alt: Post cover image
og:image:width: 1200
og:image:height: 630
og:locale: en
---

> ## Documentation Index
> Fetch the complete documentation index at: https://daily.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# GitHub - NVIDIA/SkillEvaluator: Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation t

**[Build With GenAI](https://daily.dev/sources/buildwithgenai)** · [@nhuhoang](https://daily.dev/nhuhoang) · 29 upvotes · 2 comments

## Summary

SkillEvaluator is an NVIDIA framework for checking AI agent skills and measuring their effect on task outcomes. It runs quality checks first, then compares agent runs with and without a skill. The pipeline has three tiers: Tier 1 validation, Tier 2 deduplication, and Tier 3 live agent evaluation in a sandbox. A bundled example scores 86.2/100 (B) with no LLM or API key required, against a default passing threshold of 70. It installs via 'pip install skillevaluator' and can be added to CI, Claude Code, Codex or other skill-aware agents. Support is labeled experimental, with no SLA.

## Full article

daily.dev links to this article rather than hosting it. Read it at the original source: <https://github.com/NVIDIA/SkillEvaluator>

## Community discussion

Top comments from developers on daily.dev.

**@ristotoldsep** · 2 upvotes

> Finally, testing whether a skill helps the agent instead of grading its README. nice.

## Similar posts on daily.dev

- [Detecting Vulnerabilities in Agent Skills with SkillSpector: From Green Checkmark to Real Security Judgment](https://daily.dev/posts/detecting-vulnerabilities-in-agent-skills-with-skillspector-from-green-checkmark-to-real-security-j-u6pwwx1n8) · Towards Data Science · 1 upvotes · 0 comments
- [Evaluate agent skills before they bloat your context window](https://daily.dev/posts/evaluate-agent-skills-before-they-bloat-your-context-window-vvdlfjoc7) · Google Cloud · 1 upvotes · 0 comments
- [Improving skill-creator: Test, measure, and refine Agent Skills](https://daily.dev/posts/improving-skill-creator-test-measure-and-refine-agent-skills-obmf0r4sa) · Claude · 75 upvotes · 3 comments
- [NVIDIA-Verified Agent Skills Provide Capability Governance for AI Agents](https://daily.dev/posts/nvidia-verified-agent-skills-provide-capability-governance-for-ai-agents-ynkbw6vjp) · NVIDIA Developer · 0 upvotes · 0 comments

---

Tags: [#python](https://daily.dev/tags/python), [#ai-agents](https://daily.dev/tags/ai-agents), [#ai-security](https://daily.dev/tags/ai-security)

[View this post on daily.dev](https://daily.dev/posts/3opeen2ys)

```json
{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]}
{"@context":"https://schema.org","@type":"DiscussionForumPosting","mainEntityOfPage":"https://daily.dev/posts/3opeen2ys","headline":"GitHub - NVIDIA/SkillEvaluator: Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation t","text":"Shared: GitHub - NVIDIA/SkillEvaluator: Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation t","url":"https://daily.dev/posts/3opeen2ys","datePublished":"2026-11-16T01:30:42.098Z","dateModified":"2026-11-16T01:31:59.113Z","author":{"@type":"Person","name":"Nhu Hoang","url":"https://daily.dev/nhuhoang","image":"https://lh3.googleusercontent.com/a/ACg8ocL_yB5DJTwePvc7w5L5BABzRIHyUz0AnzCEmF-PpF6WsLRknuAv=s96-c","interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"EndorseAction"},"userInteractionCount":4280}},"image":"https://media.daily.dev/image/upload/s--1KxV4ohY--/f_auto/v1722860400/public/Placeholder%2007","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":29},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":2}],"sharedContent":{"@type":"WebPage","url":"https://api.daily.dev/r/ha5DiIIfR"},"comment":[{"@type":"Comment","text":"Finally, testing whether a skill helps the agent instead of grading its README. nice.","datePublished":"2026-11-16T09:23:01.103Z","url":"https://daily.dev/posts/3Opeen2YS#c-KHVN1Xg7E","author":{"@type":"Person","name":"Risto Tõldsep","url":"https://daily.dev/ristotoldsep","image":"https://media.daily.dev/image/upload/s--i6RRoxB7--/f_auto,pg_1/v1794383659/avatars/avatar_ryDlbifZ1EuRuh3g51ryC?_a=BAMAMiiw0"},"interactionStatistic":{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":2}}],"isPartOf":{"@type":"WebPage","url":"https://daily.dev/squads/buildwithgenai","name":"Build With GenAI"}}
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Build With GenAI","item":"https://daily.dev/squads/buildwithgenai"},{"@type":"ListItem","position":3,"name":"GitHub - NVIDIA/SkillEvaluator: Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation t"}]}
```

