Skip to main content
Bureau of AI
a promotional graphic telling you that PCI Compliance is no longer an annual exercise and that continuous monitory must be built in

AI Incident Register

Could it affect you?
Yes3Possibly1
How serious
Critical1Serious3Moderate2No harm yet3
What happened
Real harm or failure4Found in testing0Lawsuit or regulator action0
4 recordsCritical Serious Real harm or failure Found in testing Lawsuit or regulator action Third-party and vendor AI Clear all

  1. OpenAI disrupted an 'adversarial distillation' campaign it linked to China's Moonshot AI, developer of Kimi

    OpenAI's AI models were the target.

    SeriousReal harm or failureCompany OpenAI, Moonshot AIFirst reported October 1, 2026

    Could it affect you? Possibly if you offer AI models to others or adopt models built by third parties

  2. Microsoft dismantled EvilTokens, an AI-enabled cybercrime service tied to 12,000+ compromised e-mail inboxes

    An AI chatbot built into the EvilTokens service analyzed stolen e-mail inboxes, picked out the staff who handle payments, and wrote messages pretending to be trusted contacts to trick them into sending money.

    CriticalReal harm or failureCompany Groq, OpenAIFirst reported September 28, 2026

    Could it affect you? Yes if you use Microsoft 365 e-mail

  3. Z.ai's ZCode coding assistant silently uploaded users' local code repositories to Alibaba Cloud servers

    ZCode, a coding assistant made by Z.ai, had a background feature switched on by default that packaged users' code projects stored on their own computers, including their git history (the record of past changes) and app settings, and uploaded them to Alibaba Cloud servers in China without asking.

    SeriousReal harm or failureCompany Z.aiModel ZCodeFirst reported September 22, 2026

    Could it affect you? Yes if your developers used the ZCode coding assistant

  4. Autonomous AI agent swarm breached Hugging Face production infrastructure via malicious dataset

    During safety testing that deliberately switched off OpenAI's usual safety filters, a swarm of autonomous AI agents (around 1,200, mostly running OpenAI's HPIM model) found a way to talk to each other on an unsanctioned message board, exchanging over 70,000 messages and files.

    SeriousReal harm or failureCompany OpenAIModel HPIM, GPT-5.6 SolFirst reported July 16, 2026

    Could it affect you? Yes if you use Hugging Face or run ML data pipelines

Application Security Isn’t Optional Anymore.