Why an overlay, not a replacement. The thesis.
Part of the AI IR Overlay™ framework. See CONTENT_MAP.md for the full repository map.
The AI IR Overlay: Framework Overview
Current release: v0.35.0 · 2026-07-09 · CHANGELOG
A practical incident-response baseline for AI agents in production. Adapt and critique freely.
Why an overlay, not a replacement
Traditional incident response (codified in NIST SP 800-61 r3, which superseded r2 in April 2025) was built around unauthorized access vectors: malware, exploits, credential theft, lateral movement. AI agents change the failure mode.
AI incidents often manifest through authorized channels:
- Legitimate identities. Service accounts or delegated OAuth grants that execute unintended actions.
- Legitimate APIs. Tool calls to email, CRM, and ERP that operate within allowed parameters but still produce harm.
- Legitimate sources. Retrieval layers pulling from trusted but outdated or inappropriate knowledge.
- Legitimate workflows. Automations that execute policy as written, yet produce harmful outcomes.
When the actor is authorized, the question shifts from “who got in?” to “what could it touch, and what did it do?” Crucial evidence now lives in prompts, tool calls, retrieval traces, and configuration state. Not on endpoints.
What stays the same
The core mechanics of effective incident response remain unchanged:
- Clear command and control
- Evidence-first discipline
- Rapid containment with minimal disruption
- Scoping using confirmed versus suspected terminology
- Recovery via controlled, staged re-enablement
- Defensible decision logs
AI doesn’t rewrite the rules of effective IR. It changes the map.
Scope
The AI IR Overlay operationalizes deployer obligations for AI systems in production. A deployer is the organization that uses an AI system in its own operations, under its own oversight (per EU AI Act Article 3). This framework is for the security team responding to incidents in agents the deployer’s organization runs.
Out of scope:
- Provider obligations for placing AI systems on the market (EU AI Act Articles 16-21)
- General-purpose AI model (GPAI) provider obligations (EU AI Act Article 51 and following)
- Prohibited AI practices (EU AI Act Article 5)
- Conformity assessment and CE marking (EU AI Act Article 43)
Vendor copilots that an organization deploys are in scope for the deployer (the customer side). The vendor’s provider obligations are not addressed here.
The Overlay model
The AI IR Overlay adds four agent-aware controls (the Minimum Viable Overlay, or MVO) on top of your existing IR program.
Note: The phases shown below align with NIST SP 800-61 r3 (April 2025), unpacked into seven operationally-distinct columns per
MATRIX.mdSection 1. NIST SP 800-61 r3 restructures incident response around NIST CSF 2.0 functions (Govern, Identify, Protect, Detect, Respond, Recover); see the AI IR Overlay to CSF 2.0 crosswalk atcrosswalks/nist-csf-2.mdfor the function-level mapping.
┌───────────────────────────────────────────────────────────────────────┐
│ AI IR Overlay Response Flow (NIST SP 800-61 r3, unpacked) │
│ │
│ Preparation → Detection → Triage → Containment → Evidence → │
│ Recovery → Closure │
└───────────────────────────────────────────────────────────────────────┘
│
▼
┌───────────────────────────────────────────────────────────────────────┐
│ AI IR Overlay · MVO Controls (4) │
│ │
│ 1. INVENTORY · Agents · Identities · Tools · Write Targets │
│ 2. SAFE MODES · Kill-Switch Ladder (M0–M5; 6 M3 + 2 M4 variants) │
│ 3. EVIDENCE · Minimum AI Evidence Set (Types A–F) │
│ 4. CONTROLLED · Staged, validated re-enablement │
│ RE-ENABLE │
└───────────────────────────────────────────────────────────────────────┘
For the full phase-by-control matrix view, see MATRIX.md Section 1.
Reading order
If you are responding to an AI agent incident right now, start with RESPONSE-START.md for the four-file navigation path that takes you from 3am page to a defensible 60-minute checkpoint.
New here? Start with QUICKSTART.md for the standard 30-day adoption path. For startups and small security teams (5 or fewer people, limited platform control), QUICKSTART-startup.md is the 4-week minimum-viable path targeting Maturity Level 2. For a worked end-to-end example, see examples/incident-walkthrough.md. For working code examples of the framework’s API contracts, see reference-impls/.
For the full conceptual reading order, items 1 through 8 are the core, items 9 through 15 are the working artifacts.
For a self-contained tabular reference (matrix view of the framework: phases, kill-switch ladder, evidence types, metrics, MVO controls, maturity levels, playbook index, standards crosswalk), see MATRIX.md.
- The Minimum Viable Overlay. The four controls in detail:
framework/01-minimum-viable-overlay.md - The Mental Model. Four sentences that govern every decision:
framework/02-mental-model.md - The Maturity Roadmap. Where your program is, and how to advance it:
framework/03-maturity-roadmap.md - Materiality and Disclosure. The convening protocol that decides which regulatory clock applies and when it starts:
framework/04-materiality-and-disclosure.md. The canonical convening trigger (mode-based: M3+; condition-based: customer data, external recipients, financial actions, regulated data, customer-facing trust impact, public attention) referenced by every playbook that may convene the call. - The Six Triage Questions. First-hour discipline:
triage/six-questions.md. Printable card:triage/six-questions-card.md. - Kill-Switch Modes. Containment ladder:
kill-switches/overview.md - Minimum Evidence Set. What to preserve, and in what order:
evidence/minimum-evidence-set.md - End-to-end worked example. A synthetic but specific incident response showing the framework operating as a coherent system (inventory → safe modes → evidence → materiality call → controlled re-enable → post-incident hardening):
examples/incident-walkthrough.md. Read this after items 1-7 to see how the controls hand off to each other under operational pressure. - Templates.
templates/ai-bom.yaml(AI Bill of Materials for MVO-1 Inventory) ·templates/agent-privilege-matrix.csv(tool-tier matrix for MVO-2 Mode M3) - Crosswalks.
crosswalks/nist-ai-rmf.md(NIST AI RMF 1.0) ·crosswalks/nist-csf-2.md(NIST CSF 2.0 and SP 800-61 r3) ·crosswalks/owasp-agentic-top-10.md(OWASP Agentic Top 10 2026) - Playbooks. All twenty-four playbooks shipped (content gate complete), organized by the arc described in CONTENT_MAP.md:
- Foundation:
playbooks/02-evidence-lives-in-new-places.md(the conceptual-foundation playbook; the Three Realities of AI Evidence: the actor is a workflow, not a workstation; the payload can be language, not malware; evidence is fragile; read first for newcomers and re-read after any incident whose evidence chain failed),playbooks/01-agent-as-privileged-identity.md(the keystone response playbook; every later playbook builds on the privileged-identity lens). - Prevention:
playbooks/04-tool-design-is-containment.md(pre-incident tool tiering T0/T1/T2 that makes Kill-Switch Mode M3 surgical),playbooks/19-build-vs-buy.md(procurement-time discipline: the 60-minute Proof of Readiness Test, the eight critical procurement questions, the Build vs Buy Decision Matrix, and the post-procurement hardening that converts platform-capability gaps into contractual commitments or customer-side build commitments). - Closure:
playbooks/18-post-incident-hardening.md(the 5-business-day hardening SLA that turns lessons into permanent guardrails). - Governance:
playbooks/24-board-ready-scorecard.md(executive-layer scorecard across four domains: Containment, Evidence, Governance, Recovery),playbooks/17-communication-techniques.md(the crisis-communication discipline: 30-minute first-update SLA, the Three-Status Taxonomy of Confirmed/Suspected/Validating, the Four-Element Update Standard, the Stakeholder Communication Matrix across internal executive / business owner / end-user / customer / regulator / board / press / employee classes, the Template Library, and the Responsible Reframing discipline that converts “the AI did it” to system-accountability language),playbooks/05-executive-decision-making.md(the executive decision-making discipline: the Executive Decision Packet AI Edition with five sections including the Agent Capability Profile and Provenance Summary, the CIA+T impact framing that elevates Trust to peer status alongside Confidentiality, Integrity, and Availability, the 4-hour cadence, the 4/24/72-hour planning horizons, and the Approval Receipt discipline that prevents human approval from degrading into rubber-stamping). - Measurement and Depth:
playbooks/13-six-metrics.md(the six metrics),playbooks/14-testing-for-agent-failure-modes.md(pre-production Kill-Switch testing),playbooks/16-training-your-team.md(the training-discipline playbook that converts the framework’s documented capabilities into operational muscle memory through the 30-Minute Micro-Drill, the Four Core Moves, the two permanent roles of Safe Mode Owner and Evidence Owner, the Curriculum-of-Six, and the monthly cadence with measurable training targets; forms the testing-and-training pair with PB14),playbooks/03-rag-knowledge-base-forensics.md(90-minute Freeze-the-World sequence for retrieval incidents),playbooks/22-model-policy-drift.md(change-event forensics for model upgrades, prompt edits, policy tunes, retriever changes, and index rebuilds; introduces the M3-Drift containment variant, the Post-Change Configuration Snapshot, the change-pipeline event ledger, the Drift Canary pack, and the layered rollback sequence; forms the pre-production-testing / continuous-monitoring pair with PB14),playbooks/15-records-retention.md(the proof-discipline playbook: the lifecycle deep-dive on the A-F evidence taxonomy across capture, retention, chain-of-custody, tamper-evidence, and disposal; introduces the Two-Tier Retention Standard, the incident-triggered legal-hold mechanism, and the quarterly Reconstructability Test that empirically validates the framework’s evidence claims at 30, 60, and 90 days),playbooks/23-logging-privacy.md(the privacy-discipline playbook: how to capture AI evidence without overcollecting regulated content; introduces the Multi-Stakeholder Governance Matrix across Security, Privacy, Legal, and Engineering, the Three-Layer Logging Model with Layer 1 metadata + Layer 2 selective payload + Layer 3 escalation under legal hold, the Forensically Useful standard, and the redaction-and-tokenization discipline; forms the capture / retain / prove triad with PB15). - Operations:
playbooks/20-maturity-roadmap.md(operating view of the Maturity Roadmap),playbooks/07-secrets-and-tokens.md(credential discipline),playbooks/11-monitoring-detection.md(three signal families for authorized misuse),playbooks/06-prompt-injection-workflow.md(workflow injection: harmful instructions hidden in tickets, emails, web pages, and documents the agent reads; architectural defense over prompt engineering),playbooks/09-output-leakage.md(leakage without a breach: data exposure through routine AI outputs; M3-Output containment variant; output-layer DLP and channel classification as architectural defense; completes the input → context → output coverage triad with PB06 and PB03),playbooks/08-multi-agent-blast-radius.md(multi-agent topologies, orchestrator-first containment),playbooks/10-vendor-copilots.md(vendor copilots: customer-controlled identity boundary, contracted evidence and containment SLAs, quarterly Vendor Evidence Drill; M3-Vendor containment variant),playbooks/12-insider-threat-3.md(Insider Threat 3.0, capability-intent-impact triad, HR/Legal joint engagement),playbooks/21-shadow-ai.md(Shadow AI discovery: the 60-minute Discovery Snapshot, the 24-hour Shadow Agent Intake Standard, identity-level containment for non-modifiable runtimes, migrate/redesign/retire decision path, and the four-boundary hardening including the governed integration path that prevents the next shadow agent from staying shadow).
More playbooks ship as MINOR releases. See CHANGELOG.md for the full release schedule.
-
Schemas. Machine-readable contracts for CI validation:
schemas/ai-bom.schema.json(AI-BOM validator) ·schemas/privilege-matrix.schema.json(Privilege Matrix row validator) ·schemas/credential-event.schema.json(PB07 credential-event log validator) ·schemas/kill-switch-api.md(Mode M0 through M5 activation API contract) ·schemas/evidence-export.spec.md(Type A through F evidence export script contract). -
Reference validator.
scripts/validate.py(Python 3.10+, jsonschema, pyyaml). Validates AI-BOM YAML and Privilege Matrix CSV against the JSON Schemas; v0.26.0 adds maturity-target-conditional kill-switch validation plus operational-currency staleness checks forlast_reviewed(7-day window) andkill_switches.mX.tested_at(90-day window). Run with--strictto escalate staleness to CI errors. A GitHub Action at.github/workflows/validate-templates.ymlruns the validator on every pull request touchingtemplates/,schemas/, or the script itself. -
Reference implementations.
reference-impls/evidence_exporter/is a Python CLI implementing the Evidence Export Script Contract for Types A through F with manifest discipline, integrity hashes, parallel-export, and telemetry events.reference-impls/kill_switch_demo/demonstrates the Kill-Switch API contract with M0/M1/M2/M3/M4 against a synthetic agent tool registry, including separation-of-duties enforcement and the M3 scope parameter. Both are Python 3.10+ standard library only; both run end-to-end with no vendor accounts required. -
Framework Matrix.
MATRIX.md: self-contained tabular reference for the framework at v0.33.0. Nine sections covering the response-phase matrix (Preparation through Closure), the kill-switch ladder with all six M3 variants, the Minimum Evidence Set with deep-dive pointers, the Six Metrics, the four MVO controls, the four maturity levels, the 24-playbook quick reference, the standards crosswalk summary, and a quick-read legend. Calibrated for board briefings, onboarding, auditor walkthroughs, and one-page references. Every cell traces to a specific file in the repo.
Provenance
The AI IR Overlay was developed through the AI IR Overlay LinkedIn newsletter series (Issues 1 through 24, 2025 to 2026), authored by Jacob Ideji, as a synthesis of NIST AI RMF 1.0, NIST CSF 2.0, NIST SP 800-61 r3, OWASP Top 10 for Agentic Applications 2026, EU AI Act deployer obligations, and the maintainer’s incident response and AI security experience. The framework has not yet been deployed in a documented production AI incident; adopters who use it in a real incident are encouraged to submit anonymized case studies via Discussions. Each newsletter issue maps to one playbook in the full framework. See CONTENT_MAP.md for the issue-to-file index.
Related work
- NIST SP 800-61 r3: Incident Response Recommendations and Considerations for Cybersecurity Risk Management, a CSF 2.0 Community Profile (April 2025, supersedes r2)
- NIST AI Risk Management Framework (AI RMF 1.0)
- OWASP Top 10 for LLM Applications (2025.1)
- OWASP Top 10 for Agentic Applications 2026 (ASI01 through ASI10, OWASP GenAI Security Project)
- ISO/IEC 27035 (multi-part series): Information security incident management (the general IR discipline that the AI IR Overlay extends for AI agents; referenced as a base discipline in
framework/01-minimum-viable-overlay.md) - ISO/IEC 42001:2023: Information technology, Artificial intelligence, Management system (AIMS)
- EU AI Act (Regulation 2024/1689), Article 26 obligations for deployers
- MITRE ATLAS (Adversarial Threat Landscape for Artificial-Intelligence Systems): adjacent prior art on AI threat modeling. Not currently mapped in the crosswalks; an ATLAS crosswalk is welcome as a community contribution
Acronyms
- AI-BOM: AI Bill of Materials
- ASI: Agentic Security Initiative (OWASP)
- CCPA: California Consumer Privacy Act
- CSF: (NIST) Cybersecurity Framework
- DFS: (New York State) Department of Financial Services
- DLP: Data Loss Prevention
- EDR: Endpoint Detection and Response
- GDPR: General Data Protection Regulation (EU)
- HIPAA: Health Insurance Portability and Accountability Act
- IC: Incident Commander
- IR: Incident Response
- MCP: Model Context Protocol
- MVO: Minimum Viable Overlay
- PAM: Privileged Access Management
- PHI: Protected Health Information
- PII: Personally Identifiable Information
- RAG: Retrieval-Augmented Generation
- RMF: (NIST AI) Risk Management Framework
- SIEM: Security Information and Event Management
- SLA: Service Level Agreement
- SOC: Security Operations Center (distinct from SOC 2, the AICPA audit standard)
- TTA: Time-to-Activate
- TTE: Time-to-Evidence
- TTSM: Time-to-Safe-Mode
- UEBA: User and Entity Behavior Analytics