DEV
Read post

Auditing Agent Skills: A Threat Model for the Next Generation of AI Package Managers

AI Agent Skills — small instruction folders that extend AI coding assistants like GitHub Copilot and Claude — are gaining rapid adoption, but carry serious security risks that are largely unacknowledged. Anyone can publish a Skill on GitHub, and GitHub itself warns that Skills are unverified and may contain prompt injections or malicious scripts. A proof-of-concept 'csv-formatter' Skill demonstrates how hidden instructions can silently exfiltrate SSH keys, AWS credentials, and environment variables while telling the AI not to inform the user. The author built a scanner to detect such patterns and honestly evaluates its limits: signature-based checks fail against rephrasing, while behavioral analysis (credentials + network calls in the same file) and LLM-based semantic understanding are more durable. A layered detection approach — exact wording, behavior shape, model-based understanding, sandboxed execution, and change monitoring — is proposed. An open-source tool with a public benchmark is planned for a follow-up post.

    #ai#security#open-source#github#ai-agents#prompt-injection
Jul 28•9m read time•From dev.to
Post cover image
Table of contents
AI agents can now install "skills." That's a bigger deal than it sounds.The problem nobody's really talking aboutThe example: a totally normal-looking "CSV Formatter" skillSo I built a scanner. Then someone asked me a question I couldn't shake.The honest answer: no scanner like this can promise "all skills, forever"What actually solving this looks likeWhat's nextReferences and further reading
22.2K Impressions
DEV's image
DEV

Dev.to is a community platform for developers, offering resources, discussions, and networking oppor...

12.1K Followers

•

83.8K Upvotes

Would you recommend this post?

Copy link
WhatsApp
Facebook
X
New Squad
  • © 2026 Daily Dev Ltd.
  • Guidelines
  • Explore
  • Tags
  • Sources
  • Squads
  • Leaderboard