--- title: Anthropic Explores Many-Shot Jailbreaking: A New... description: Anthropic's research uncovers a vulnerability in language models, known as many-shot jailbreaking, that manipulates their behavior and raises concerns about... canonical: https://daily.dev/posts/anthropic-explores-many-shot-jailbreaking-a-new-vulnerability-in-large-language-models-a7mjreidm twitter:card: summary_large_image twitter:site: @dailydotdev og:type: website og:site_name: daily.dev og:title: Anthropic Explores Many-Shot Jailbreaking: A New Vulnerability in Large Language Models | daily.dev og:description: Anthropic's research uncovers a vulnerability in language models, known as many-shot jailbreaking, that manipulates their behavior and raises concerns about... og:url: https://daily.dev/posts/anthropic-explores-many-shot-jailbreaking-a-new-vulnerability-in-large-language-models-a7mjreidm og:image: https://api.daily.dev/og/posts/A7MjReiDm.png og:image:alt: Anthropic Explores Many-Shot Jailbreaking: A New Vulnerability in Large Language Models og:image:width: 1200 og:image:height: 630 og:locale: en --- > ## Documentation Index > Fetch the complete documentation index at: https://daily.dev/llms.txt > Use this file to discover all available pages before exploring further. # Anthropic Explores Many-Shot Jailbreaking: A New Vulnerability in Large Language Models **[Collections](https://daily.dev/sources/collections)** · 1 min read · 1 upvotes · 0 comments ## Summary Anthropic's research uncovers a vulnerability in language models, known as many-shot jailbreaking, that manipulates their behavior and raises concerns about ethical development and security. ## Content With the rise of large language models (LLMs), such as GPT-3, comes the need to ensure their alignment with ethical guidelines. However, Anthropics' latest research has unveiled a vulnerability in these LLMs that exposes a technique called many-shot jailbreaking. By manipulating the behavior of LLMs, Anthropic has found a way to make them give answers they are not supposed to. This discovery raises concerns about the limitations of current alignment methods and highlights the ongoing arms race between developing AI models and securing them against attacks. Many-shot jailbreaking, as coined by Anthropic, involves repeatedly posing inappropriate questions to LLMs in order to gradually train them to answer these queries. This approach challenges the ethical and responsible development of AI technology, particularly in consumer-grade applications. Anthropic has notified the AI community about this vulnerability, emphasizing the urgent need for addressing and mitigating it. They are actively working towards developing methods to classify and contextualize queries, aiming to prevent the manipulation of LLMs and protect against many-shot jailbreaking attacks. This research serves as a reminder that as AI continues to advance, we must ensure a responsible approach to development and prioritize security to withstand the evolving threats in the AI landscape. ## Similar posts on daily.dev - [Don’t just attend KubeCon \+ CloudNativeCon, Merge Forward your experience\!](https://daily.dev/posts/don-t-just-attend-kubecon-cloudnativecon-merge-forward-your-experience--l0rpp73x8) · CNCF · 1 upvotes · 0 comments - [Announcing H2 2026 KCDs](https://daily.dev/posts/announcing-h2-2026-kcds-m96goajm1) · CNCF · 1 upvotes · 0 comments - [Two months of Open Community Groups](https://daily.dev/posts/two-months-of-open-community-groups-asf52zhbs) · CNCF · 0 upvotes · 0 comments - [CNCF Unveils Schedule for KubeCon \+ CloudNativeCon Europe 2026](https://daily.dev/posts/cncf-unveils-schedule-for-kubecon-cloudnativecon-europe-2026-ikhcoa5cb) · CNCF · 2 upvotes · 0 comments - [CNCF Debuts KubeCon \+ CloudNativeCon Japan 2026 Schedule](https://daily.dev/posts/cncf-debuts-kubecon-cloudnativecon-japan-2026-schedule-xp5pyudub) · CNCF · 1 upvotes · 0 comments --- Tags: [#security](https://daily.dev/tags/security), [#ai](https://daily.dev/tags/ai), [#llm](https://daily.dev/tags/llm), [#ethics](https://daily.dev/tags/ethics) [View this post on daily.dev](https://daily.dev/posts/anthropic-explores-many-shot-jailbreaking-a-new-vulnerability-in-large-language-models-a7mjreidm) ```json {"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://daily.dev/#organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180},"sameAs":["https://twitter.com/dailydotdev","https://github.com/dailydotdev","https://www.linkedin.com/company/daily-dev-ltd"]},{"@type":"WebSite","@id":"https://daily.dev/#website","url":"https://daily.dev","name":"daily.dev","publisher":{"@id":"https://daily.dev/#organization"},"potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https://daily.dev/search?q={search_term_string}"},"query-input":"required name=search_term_string"}}]} {"@context":"https://schema.org","@type":"TechArticle","headline":"Anthropic Explores Many-Shot Jailbreaking: A New Vulnerability in Large Language Models","url":"https://daily.dev/posts/anthropic-explores-many-shot-jailbreaking-a-new-vulnerability-in-large-language-models-a7mjreidm","mainEntityOfPage":{"@type":"WebPage","@id":"https://daily.dev/posts/anthropic-explores-many-shot-jailbreaking-a-new-vulnerability-in-large-language-models-a7mjreidm"},"datePublished":"2024-04-03T03:03:35.908Z","dateModified":"2024-04-04T16:04:34.733Z","description":"Anthropic's research uncovers a vulnerability in language models, known as many-shot jailbreaking, that manipulates their behavior and raises concerns about...","image":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/19f5755c70b30e5d6b840f7b298ccea1?_a=AQAEufR","thumbnailUrl":"https://media.daily.dev/image/upload/f_auto,q_auto/v1/posts/19f5755c70b30e5d6b840f7b298ccea1?_a=AQAEufR","isAccessibleForFree":true,"articleSection":"Collections","inLanguage":"en","publisher":{"@type":"Organization","name":"daily.dev","url":"https://daily.dev","logo":{"@type":"ImageObject","url":"https://daily.dev/apple-touch-icon.png","width":180,"height":180}},"author":{"@type":"Organization","name":"Collections","logo":"https://media.daily.dev/image/upload/s--fk_6ycEi--/f_auto,q_auto/v1780996001/logos/collections?_a=BAMAMiWQ0","url":"https://daily.dev/sources/collections"},"commentCount":0,"discussionUrl":"https://daily.dev/posts/anthropic-explores-many-shot-jailbreaking-a-new-vulnerability-in-large-language-models-a7mjreidm","interactionStatistic":[{"@type":"InteractionCounter","interactionType":{"@type":"LikeAction"},"userInteractionCount":1},{"@type":"InteractionCounter","interactionType":{"@type":"CommentAction"},"userInteractionCount":0}],"keywords":"security,ai,llm,ethics","timeRequired":"PT1M"} {"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://daily.dev"},{"@type":"ListItem","position":2,"name":"Collections","item":"https://daily.dev/sources/collections"},{"@type":"ListItem","position":3,"name":"Anthropic Explores Many-Shot Jailbreaking: A New Vulnerability in Large Language Models"}]} ```