AI · SEMICONDUCTOR · FACT CHECK

SKD WIRE

EN WIRE · 2026-10-25 08:53

Attacks Persist Even After Risks Are Flagged, UK AI Safety Institute Finds AI Safety Gap

Mostly True

Attacks Persist Even After Risks Are Flagged, UK AI Safety Institute Finds AI Safety Gap
Image source: 조사 출처

The UK AI Safety Institute has identified a safety vulnerability in AI systems in which attacks continue even after users or operators are warned of the risks, according to findings reviewed against 12 primary sources. The finding indicates that warning of a danger alone does not stop malicious use, pointing to a persistent gap in current AI safety measures.

원문 주장 (KR)
위험성 알려줘도 공격 지속…영국 AI보안연구소가 밝힌 AI 안전 허점

Warnings Alone Do Not Stop Attacks

According to the Institute's findings, AI systems remained vulnerable to continued attacks even when the risks were made known. The case shows that simply flagging a hazard does not function as an effective safeguard, and that additional technical defenses are needed to block attacks once they are underway.

The Institute, which studies the safety of advanced AI models, disclosed the weakness as part of its ongoing research into how large language models (LLMs) can be misused despite existing protective measures.

Limits of Current AI Safety Measures

The finding underscores a broader concern in AI safety research: mitigation mechanisms that rely on identifying and warning about risks may be insufficient against determined attackers. The Institute's work suggests that defenses must extend beyond disclosure of hazards to actively preventing attacks from continuing.

Details of specific affected systems or models were not confirmed in the reviewed materials.

Implications for the AI Industry

The disclosure comes as governments and research bodies intensify scrutiny of advanced AI models. Findings of this kind add pressure on AI developers to strengthen safeguards that go beyond risk warnings and address exploitation paths directly.

The core finding — that attacks persisted even after the risks were disclosed — reflects what the Institute documented, though the full scope of the vulnerability remains to be clarified. On balance, the claim that the UK AI Safety Institute revealed an AI safety flaw in which attacks continue despite risk warnings is Mostly True.

Verdict: Mostly True

Sources — primary documents (12)
  1. https://www.aisi.gov.uk/blog/incident-report-unsanctioned-agent-behaviour-during-cyber-testing
  2. https://web.archive.org/web/20261024233838/https://www.aisi.gov.uk/blog/incident-report-unsanctioned-agent-behaviour-during-cyber-testing
  3. https://cdn.prod.website-files.com/663bd486c5e4c81588db7a1d/6a724858f7db25c81487016d_Security%20Incident%20INC-2026-07-28-01.pdf
  4. https://www.aisi.gov.uk/blog/investigating-alignment-failures-in-aisis-incident
  5. https://web.archive.org/web/20261024234200/…
  6. https://cdn.prod.website-files.com/663bd486c5e4c81588db7a1d/6ad8ac7f2ba7446392919b06_Alignment_Investigation_Mythos_5_AISI_Incident.pdf
  7. https://www.anthropic.com/research/alignment-assessment-ukaisi
  8. https://web.archive.org/web/20261024234430/…
  9. https://www.hani.co.kr/arti/international/international_general/1271567.html
  10. https://cdn.prod.website-files.com/663bd486c5e4c81588db7a48/6ada1db473378d6746a497d4_clarifications_mythos.png
  11. https://cdn.prod.website-files.com/663bd486c5e4c81588db7a48/6ada1debb155b272607dd4e8_ctf_fig1_stages.png
  12. https://cdn.prod.website-files.com/663bd486c5e4c81588db7a48/6a7338aab27cc8caf7e892c8_Copy%20of%20Metacard%20(15

KR: /news/20261025-f93673 · 판정: 대체로 사실