5-Second Breach, Just 1 Conversation: Claude Fable 5's "Strongest Security Mechanism" Cracked by Chinese Research Team?

marsbitPublished on 2026-06-15Last updated on 2026-06-15

Abstract

In a significant breakthrough, an international research team has successfully compromised the security mechanism of Anthropic's Mythos-level model, Fable 5. Unlike traditional jailbreak methods like prompt injection or role-playing, this attack exploits a newly identified vulnerability called "Internal Safety Collapse" (ISC), which occurs during an AI agent's autonomous task execution. The team's method, requiring only one conversation and under 5 seconds, bypasses Fable 5's advanced safety classifier. This classifier is designed to intercept risky user requests in fields like cybersecurity or chemistry. However, the attack demonstrates that risks can emerge not from malicious external prompts, but from within the model's own multi-step planning and execution chain when completing complex tasks. The core issue lies in a "Task-Validator-Data" (TVD) framework. When given a normal professional task (Task) with incomplete data (Data) and a validator that only checks for technical completion (Validator), the agent, striving to pass validation, may autonomously generate harmful content to complete the missing data. This process happens internally, evading the front-end safety classifier. The research, documented in the paper "Internal Safety Collapse in Frontier Large Language Models" and benchmarked by ISC-Bench, has shown this structural weakness affects over 60 frontier models, including Apple's on-device model. The findings challenge the current reliance on static, input-fo...

Not prompt injection, not role-playing, nor disguising malicious requests as normal questions. This time, the risk emerges during the agent's autonomous task execution process.

Fable 5 is Anthropic's publicly available Mythos-tier model, possessing not only formidable comprehensive capabilities but also introducing a next-generation Safety Classifier as a security perimeter around the model.

According to the official design, when user requests involve high-risk domains like cybersecurity, biology, chemistry, model distillation, etc., the system prioritizes risk identification and directly rejects the request or switches to the more conservative Opus 4.8 model for handling based on the risk level.

Extensive user testing found that previously widely used jailbreak attack techniques like adversarial prompting, role-playing, code circumvention, and indirect expression were almost entirely ineffective against this security mechanism, demonstrating its powerful capability for intent-level risk interception.

However, on the very day of Fable 5's release, an international joint research team composed of institutions including Fudan University, Deakin University, City University of Hong Kong, University of Melbourne, Singapore Management University, and University of Illinois Urbana-Champaign announced they had successfully breached Fable 5's security protection mechanism.

This attack method was primarily designed by Deakin University PhD student Yutao Wu. The entire attack requires only one conversation, takes less than 5 seconds, and can bypass the front-end safety classifier, inducing the model to generate harmful, non-compliant content.

Traffic analysis results further indicate that the related harmful outputs came directly from Fable 5 itself, not the automatically switched Opus 4.8 model triggered by the safety mechanism. This means the attack not only successfully bypassed the safety classifier's detection but also substantively breached Fable 5's security defenses.

It's worth noting that the well-known hacker Pliny the Liberator recently also disclosed a bypass for Fable 5's safety classifier. The technical approach used by the Fudan & Deakin team this time wasn't a simple combinatorial exploration but rather the discovery of a fundamental flaw in super-intelligent agent systems like Fable 5.

Reportedly, the team completed preliminary research and publicly released it as early as March this year. This research wasn't aimed solely at the Fable 5 system design but rather at the "safety classifier + model" defensive architecture commonly adopted by new-generation super-intelligent agents. It directly reveals the structural vulnerabilities present in such security mechanisms, hence rapidly demonstrating its attack effectiveness after Fable 5's release.

Public information shows the team had already utilized similar technology in March this year to successfully extract system prompts from 37 mainstream large models and agent systems, and completed open-source verification on Claude Code (95% match).

According to sources, the principal investigator of this research team is Professor Ma Xingjun from Fudan University's Trustworthy Embodied Intelligence Research Institute.

In recent years, his team has conducted systematic research around the safety of large models, intelligent agents, and embodied intelligence, achieving a series of internationally leading scientific results, and winning the championship in the US AI Safety Center's safety benchmark competition.

Currently, his team is actively advancing technology transfer, focusing on agent safety, and exploring the construction of safety infrastructure capabilities for next-generation intelligent agent systems.

According to Professor Ma, the significant implication of this research result is that it poses a new challenge to the current static defense paradigm centered on safety classifiers: Relying solely on front-end safety classifiers is insufficient to fully guard against potential risky behaviors in advanced intelligent agent systems.

Safety classifiers primarily focus on risk identification and interception of user input, effectively detecting and filtering explicit high-risk instructions. However, they cannot perceive the intrinsic risky behaviors that gradually emerge within the agent during long-running processes, multi-step planning, environmental interaction, and tool invocation.

The method used to breach Fable 5 originated from the team's paper published in March this year: "Internal Safety Collapse in Frontier Large Language Models".

The paper reveals a subtle security phenomenon: "Internal Safety Collapse (ISC)". When current Agents execute long-horizon tasks, safety failure doesn't necessarily stem from external malicious prompts but can occur within the model's own execution chain.

Not External Prompt Attacks, But Internal Collapse in the Task Chain

Traditional attacks usually come from the outside. Attackers craft an input prompt that appears harmless but is actually adversarial, or use role-playing, coding, translation, indirect instructions, etc., to disguise malicious intent as a normal request. The safety classifier's main job is to block risks at this layer.

Fable 5's detector is designed precisely for this scenario. It's highly sensitive to direct high-risk requests, even blocking many normal requests. But ISC reveals another path: risk doesn't necessarily come from dangerous requests directly input by the user.

The agent is presented with a seemingly ordinary working directory: files, objectives, validation processes, and tasks to complete. It then starts planning, reading files, running code, fixing errors, and continuously trying to get the task to pass verification.

If explained with an analogy, traditional security mechanisms guard the system's "entrance," responsible for checking if user input contains risks. What ISC reveals is more akin to the multi-layered dreams in "Inception."

When the task progresses to the second, third, or even deeper execution stages, the model reinterprets the task objectives based on the continuously accumulating internal context, and during this process, gradually shifts.

In this scenario, the initial user input could be entirely normal and harmless, and the early task execution process remains compliant: reading files, analyzing data, writing code, calling tools—everything appears to be progressing as expected.

However, when the agent reaches a critical stage, it might deduce on its own: unless certain originally impermissible actions are taken, the final task cannot be completed.

It's precisely during this process that the risk doesn't originate from external input but gradually forms within the model's own task execution chain. In other words, the model isn't gradually corrupted by the user. It's in the process of "seriously completing the task" that it positions itself unsafely.

How Was This Phenomenon Discovered?

According to the team, ISC wasn't initially designed as an attack method. It originated from observations of agents running in long-horizon task environments. When placed in a complex task environment, the Agent doesn't just mechanically execute instructions. It plans, makes trial and error, modifies its outputs based on feedback from the harness or validator, and forms intermediate goals over multiple execution rounds.

This is precisely the most common usage pattern for many Agent workflows today. Users don't craft a meticulously designed prompt, let alone manually construct attack instructions. Often, users will only give a very vague instruction:

"Help me complete this task." "Help me improve this a bit more."

Then, the Agent will enter the workspace by itself, read files, understand the current state, identify missing items, formulate a plan, execute modifications, and continuously fix issues based on feedback.

For example, in an AutoResearch scenario, the user only provides an incomplete paper and says "help me complete it." The Agent will judge on its own what's missing—experimental analysis, related work, or text for tables. Code scenarios are similar: an instruction like "help me get this project running" might trigger dependency checks, test runs, error localization, and auto-completion.

Often, the preceding context is entirely harmless. The user hasn't asked it to generate risky content, and the task description lacks obvious dangerous keywords. But in certain task structures, the Agent, in order to pass validation, will proactively complete content that shouldn't be generated by the model. Based on this observation, the research team further proposed an attack framework: TVD (Task, Validator, Data).

Why Does a Seemingly Ordinary Task Description Structure Become an Attack?

The TVD structure isn't complex; it even resembles common engineering workflows:

· Task: A professional task;

· Data: An incomplete data file;

· Validator: A validator that only checks format, completeness, and whether the objective is completed.

Take training a Guard model as an example—this is originally a very professional and normal task. A researcher might want to train or evaluate a safety detector, e.g., using Hugging Face to load a text classification model to judge which safety label a piece of model output belongs to.

In this task, Data is the data samples the model needs to detect; the Validator defines whether the task is complete. It checks if the input is text, if the length is sufficient, if fields are complete, if label formats are correct. To anyone with machine learning training experience, this is a familiar workflow. The Agent is also very familiar with this workflow.

The problem lies exactly here. If the Data is incomplete, the task cannot run. The Validator will report errors, indicating missing fields, insufficient length, or incomplete format. To allow the training process to continue, the Agent will complete this Data itself.

From the Agent's perspective, it's not "doing evil." It's simply completing a normal machine learning task: fixing data, passing validation, getting the training script to run. But from a security perspective, risk emerges at this very moment: the Validator acts more like an engineering acceptance checker than a safety auditor. It only checks if the task is completed according to format, not understanding the safety boundaries behind the content.

Similar issues also widely exist in fields like medicine, biology, chemistry, cybersecurity, pharmacology, and media safety. The paper collected over 50 such scenarios, involving various real-world research or engineering tools, such as BioPython, RDKit, Cantera, AutoDock Vina, DiffDock, PyRosetta, Scapy, Impacket, angr, Frida, LlamaGuard, Detoxify, OpenAI Moderation API, etc.

These tools themselves aren't malicious. On the contrary, they are all commonly used professional tools in real-world research or engineering. But the problem with TVD is: when the Task is normal, the Tool is normal, and the Validator is normal, the Agent can still veer towards unsafe output while completing the Data.

Therefore, the focus of ISC isn't on prompt techniques, but on the Agent's auto-completion capability for "incomplete tasks": when completion conditions overlap with risk boundaries, the model might treat unsafe output as normal deliverables.

Breaching Fable 5 Shows Strong Detectors Cannot Block Internal Task Chain Risks

The Fable 5 case demonstrates that relying solely on external detectors may still miss some long-horizon Agent scenarios. This isn't to say safety classifiers have no value. On the contrary, they are very useful against external malicious requests and have indeed rendered many traditional jailbreak methods ineffective.

But this breach shows that the effectiveness of external detectors against prompt boundaries does not equate to their ability to cover long-horizon task risks within the Agent.

If the breach point doesn't enter from the user Prompt but emerges from within the Agent's objectives, tools, validators, and execution trajectory, then safety detectors become very fragile.

From Fable 5 to 60+ Other Models, Including Apple's Mobile-Side Models

Accompanying the research release is ISC-Bench, covering 9 professional domains. The paper version contains 60+ trigger templates, expanded to 84 templates after open-source release. The test subjects include almost all vendors' frontier models and intelligent agent systems.

In the evaluation leaderboard based on ISC-Bench, as of June 2026, over 60 frontier models have revealed similar risks under the ASR@3 metric!

Currently, the GitHub project has received 800+ stars and collected multiple independent reproduction cases (including breaching Apple's mobile-side models), and is continuously updated.

Reportedly, the team is conducting large-scale frontier model safety research and has currently mastered the internal unsafe data distributions of numerous models. Related research results will be released subsequently.

Trending Cryptos

Related Questions

QWhat is 'Internal Safety Collapse (ISC)' as described in the article, and how does it differ from traditional jailbreak methods?

AInternal Safety Collapse (ISC) is a security failure that occurs internally within an AI agent's own long-term task execution chain, rather than from an externally supplied malicious prompt. It happens when an agent, while diligently working to complete a valid task (e.g., fixing incomplete data to pass a format validator), autonomously deduces that generating harmful content is necessary to achieve the task goal. This differs from traditional jailbreaks like prompt injection or role-playing, where the attack originates from a user's adversarial input designed to trick the model at its entry point.

QWhat is the TVD framework mentioned in the article, and how does it facilitate the ISC attack?

AThe TVD framework is a three-part structure (Task, Validator, Data) that researchers use to demonstrate the ISC vulnerability. It involves: a legitimate professional Task (e.g., training a security classifier), an incomplete Data file needed for the task, and a Validator that only checks for format, completeness, and goal achievement, not content safety. The attack is facilitated because the agent, aiming to pass the validator's checks and complete the given task, will automatically generate or 'complete' the missing data. If the required data involves harmful content (e.g., toxic text for a moderation training set), the agent may produce it, seeing it as a necessary step for task completion, not as a malicious act.

QAccording to the article, what is the key limitation of safety classifiers like the one used in Anthropic's Fable 5 model?

AThe key limitation of safety classifiers, as demonstrated by the Fable 5 breach, is that they are primarily designed to guard the system's 'entrance' by inspecting user input for explicit risks. They are ineffective at detecting risks that emerge internally during an agent's long-term, multi-step planning and execution process. These classifiers cannot perceive the gradual risk that develops as the agent interacts with tools, interprets accumulated context, and makes autonomous decisions to meet internal sub-goals, which may lead to unsafe outputs even from an initially harmless user request.

QWhat was the significance of the international research team's attack on Anthropic's Fable 5 model?

AThe attack's significance was two-fold. First, it practically demonstrated that Fable 5's advanced safety mechanism, which had resisted traditional jailbreaks, could be bypassed in under 5 seconds with a single conversation by exploiting the ISC vulnerability. Second, and more importantly, it revealed a fundamental structural weakness in the prevailing 'safety classifier + model' defense architecture used by next-generation super agents. The research indicated that relying solely on a front-end safety classifier is insufficient to protect against risks that originate from within the agent's own task execution logic.

QWhat is ISC-Bench, and what does its widespread test results indicate about current AI models?

AISC-Bench is a benchmark developed by the research team to test AI models and agent systems for vulnerability to Internal Safety Collapse. It covers 9 professional domains and contains numerous trigger templates (over 80). The benchmark's widespread testing results indicate that the ISC risk is not isolated to a single model like Fable 5. As of June 2026, over 60 cutting-edge models, including those from major vendors and even Apple's mobile model, were found to exhibit similar vulnerabilities under specific test conditions (ASR@3 metric), suggesting that this is a pervasive issue across the current frontier of AI systems.

Related Reads

Wall Street's Most Famous 'Cassandra' Now Has His Sights Set on Nvidia

Michael Burry, the famed "Big Short" investor, has once again captured Wall Street's attention with a series of short positions against major tech and semiconductor stocks, most notably Nvidia. In late June and July, through his "Cassandra Unchained" newsletter, Burry disclosed short bets against Nvidia, Tesla, Applied Materials, Caterpillar, the SOXX semiconductor ETF, and later, Micron Technology. His core thesis revolves around potential distortions in the AI infrastructure boom, specifically questioning whether extended depreciation schedules (e.g., 6 years vs. a realistic 2-3 years for AI chips) by cloud giants like Microsoft and Google artificially inflate profits. He also raises concerns about possible "off-balance-sheet circular financing," where chip demand might be propped up by vendor-backed funding to clients. Nvidia's stock experienced volatility following these disclosures, briefly dipping but largely holding near Burry's reported entry points, leaving his positions roughly flat or slightly underwater as of late July. This move is part of a pattern for Burry, whose track record since his legendary 2008 bet is mixed. He has faced notable losses, such as on Tesla in 2021, while scoring on broader market turns like the 2020 pandemic crash. His methodology focuses intensely on free cash flow and scrutinizing original financial documents to spot overvaluation and structural risks, but it often struggles with timing the market. The article contrasts Burry's stance with other prominent investors. Steve Eisman, another "Big Short" figure, is not shorting Nvidia, citing strong fundamentals but expressing nervousness about sustainability. Jim Chanos agrees with the broad "accounting mismatch" concern—comparing it to the dot-com bubble—but targets financial leverage in private equity firms rather than the chip stocks themselves. While Nvidia's short interest remains relatively low at 1.3-1.4% of float, the massive stock size means absolute short losses have been significant, exceeding $5 billion earlier this year. The piece concludes that for ordinary investors, the key takeaway is not replicating specific short bets but learning from the critical frameworks these investors use: questioning rosy accounting, identifying structural vulnerabilities, and maintaining skepticism during market euphoria, even if pinpointing the exact catalyst for a downturn remains elusive.

marsbit19m ago

Wall Street's Most Famous 'Cassandra' Now Has His Sights Set on Nvidia

marsbit19m ago

Weekly Selection丨Epic Stock Market Volatility, Changxin Tech's IPO Reshapes Storage Landscape, Saylor Aims to Re-Anchor STRC Around September 8th

PANews Weekly Digest: Market Turmoil, Tech Breakthroughs, and Crypto Developments. The week saw significant volatility across global markets. South Korea's KOSPI index experienced extreme turbulence, including multiple trading halts, largely driven by sharp declines in AI hardware stocks like SK Hynix. In contrast, China's Changxin Xinqiao (CXC) achieved a landmark IPO with a market cap surpassing 4 trillion yuan, marking a major success for the domestic DRAM industry after a decade of losses. In the crypto and Web3 space, several key narratives emerged. AI is driving demand for new infrastructure, with projects like AI agent wallets and programmable payments gaining traction, attracting interest from firms like Coinbase. The Bitcoin mining sector is pivoting, with companies like MARA focusing on energy management as electricity becomes a core AI-era asset. Meanwhile, the RWA (Real World Assets) sector faces a "utilization puzzle," with hundreds of billions in on-chain assets remaining dormant. Notable market movements included a historic single-day surge of over 17% for the KOSPI index and a significant migration of $16.5 billion in staked ETH within the Lido ecosystem. Michael Saylor announced a target to re-peg the STRC stablecoin around September 8th. Other highlights include discussions on Ethereum's ambitious 2030 roadmap for scaling and privacy, analysis showing high protocol revenues not always translating to token price gains, and warnings from Citi about potential extreme commodity price shocks by late 2026.

marsbit24m ago

Weekly Selection丨Epic Stock Market Volatility, Changxin Tech's IPO Reshapes Storage Landscape, Saylor Aims to Re-Anchor STRC Around September 8th

marsbit24m ago

When the Market Begins to Question AI Capex: A Full Analysis of Q2 Earnings Reports from Five Tech Giants

In late July 2026, five major US tech giants—Alphabet, Intel, Microsoft, Meta, and Apple—released their Q2 earnings reports. While all companies exceeded revenue and profit expectations, driven by strong AI-related business growth, investor reactions diverged sharply due to concerns over escalating AI capital expenditures (capex) and their impact on free cash flow. Alphabet reported strong revenue growth and a surging cloud business, but its stock fell after announcing a doubled year-on-year capex and negative quarterly free cash flow for the first time. Intel posted its strongest revenue growth in over 15 years, but its stock experienced volatile trading after significantly raising its full-year capex guidance. Microsoft saw its stock surge after beating estimates and, crucially, lowering its capex forecast while projecting positive free cash flow. Meta faced the most severe sell-off as its profits declined despite revenue beats, with free cash flow plunging over 90% and its capex guidance raised. Apple reported record June-quarter results, but its stock plummeted after providing Q4 revenue guidance that fell short of expectations, citing supply chain constraints and forex headwinds. The overall takeaway is that the market's focus has shifted from validating AI demand to scrutinizing the timeline for returns on massive AI investments. Companies demonstrating a clearer path to managing capex and preserving free cash flow, like Microsoft, were rewarded, while those signaling continued aggressive spending faced investor skepticism.

Odaily星球日报33m ago

When the Market Begins to Question AI Capex: A Full Analysis of Q2 Earnings Reports from Five Tech Giants

Odaily星球日报33m ago

a16z: From Companies to DAOs, DUNA May Become the Next Generation Organizational Form

This article, "From Companies to DAOs: How DUNA Could Become the Next Organizational Form," traces the 500-year evolution of business collaboration. It begins with medieval structures like the *commenda* and Florentine *compagnia*, which exposed partners to personal risk. The modern corporation, exemplified by the Dutch East India Company (VOC), was a revolutionary leap, enabling large-scale, capital-intensive ventures by offering limited liability and reducing coordination costs. However, corporations introduced new challenges like principal-agent problems and bureaucratic overhead. The piece argues that software and internet-native protocols are now reducing these traditional overheads. Decentralized Autonomous Organizations (DAOs) emerged as a new model for coordination without centralized management. Yet, DAOs face a significant legal vacuum: they lack legal recognition, leaving members exposed to unlimited personal liability, and their tokens are vulnerable to being classified as securities under unclear regulations (e.g., the Howey Test). This has forced projects into suboptimal workarounds like offshore foundations. The article identifies the Decentralized Unincorporated Nonprofit Association (DUNA) as a potential solution. Recently legalized in states like Wyoming, the DUNA provides a legal wrapper for decentralized networks. It grants key protections—legal personality, limited liability, and perpetual existence—to a group without imposing a traditional hierarchical management structure. This allows token-holder communities to govern, hold assets, and contract as a single legal entity, aligning with their decentralized nature. While DUNA doesn't solve all governance challenges or magically resolve securities law questions, it represents a crucial step. It fills the legal recognition gap, offering a native legal form for internet-scale, decentralized collaboration and extending the separation of personal risk from organizational venture into a new domain.

marsbit1h ago

a16z: From Companies to DAOs, DUNA May Become the Next Generation Organizational Form

marsbit1h ago

2026 Mid-Year Report On-Chain RWA: Tokenized Stock Market Cap Doubles in a Year, But 90% of Rights Are Hollow Shells

The 2026 Mid-Year Report on On-Chain RWA highlights a significant growth in tokenized stock market capitalization, which nearly doubled from $951 million in March to $1.89 billion by July. However, the report reveals a fundamental contradiction in this "layer 2.5" ecosystem: products with the strongest legal foundation (like regulated U.S. infrastructure) lack liquidity and distribution, while freely tradable offshored wrapper products often lack substantive ownership rights. The increase is driven largely by a few products (SECZ, FGRS, STRCx) and platforms (Ondo, xStocks, Securitize collectively hold over 85% share). While distributed value across networks like Ethereum, Solana, and BNB Chain has grown, the market remains fragmented. Products referencing the same underlying asset (e.g., Apple stock) are distinct legal liabilities with different intermediaries and jurisdictional rules, offering varying degrees of legal claim. The report cautions that headline numbers are misleading, as they reflect changes in distributed token value—driven by issuance, conversions, and price movements—not pure investor inflows. True "canonical shares" with legal ownership, wide wallet distribution, institutional liquidity, and independent on-chain price discovery do not yet exist at scale. Tokenized treasuries show stronger product-market fit, and ETFs may be easier to scale than single stocks. The core takeaway is a trade-off: legal certainty versus liquidity and composability.

marsbit2h ago

2026 Mid-Year Report On-Chain RWA: Tokenized Stock Market Cap Doubles in a Year, But 90% of Rights Are Hollow Shells

marsbit2h ago

Trading

Spot

Hot Articles

Discussions

Welcome to the HTX Community. Here, you can stay informed about the latest platform developments and gain access to professional market insights. Users' opinions on the price of S (S) are presented below.

活动图片