AI agent incident response NZ

AI Agent Incident Response NZ

What to do when an AI agent does the wrong thing

An AI agent incident response plan tells your business how to pause, contain, review, correct, and learn from an automation mistake.

AI agent incident response is the process a New Zealand business follows when an AI agent sends, updates, publishes, recommends, classifies, or reports something wrong. The goal is to stop further harm, preserve evidence, correct the affected work, and decide whether the agent can restart.

For a small or mid-sized business, this can be a one-page operating rule: who can pause the workflow, what gets logged, who reviews the incident, and what must change before the agent runs again.

If you are still planning the workflow, define the response plan before build. The $1,000 AI Agent Assessment maps the workflow, approval gates, escalation points, logs, and rollback rules before an agent touches live work.

What counts as an AI agent incident?

An AI agent incident is any unexpected or unsafe agent action that creates business risk, customer confusion, data exposure, inaccurate records, unsupported claims, or extra work for reviewers.

Incident response is not only for major failures

A major incident could be a customer email sent with the wrong promise, a website page published with an unsupported claim, or a CRM record changed in a way that affects a sales handoff. Smaller incidents matter too: bad classifications, missing sources, wrong summaries, failed tool calls, or review queues that hide risky items.

The point is to keep the business in control when the workflow behaves differently from the design.

Incident response vs escalation rules

AI agent escalation rules tell the agent when to stop before a risky action. Incident response starts when the stop rule fails, the agent behaves unexpectedly, or a person finds an error after the agent has already prepared or affected work.

Good escalation reduces unmanaged risk. Incident response handles the cases that still happen.

Bounded access

The AI agent incident response checklist

Use this checklist when an AI agent sends, updates, publishes, recommends, reports, or routes the wrong thing.

1. Pause the workflow

Stop the agent or automation path first. Do not keep testing inside the live workflow while the same mistake can repeat. If the agent has tool access, pause the trigger, remove write access, disable the scheduled run, or switch the workflow to draft-only mode.

2. Preserve the evidence

Capture what happened before editing records or deleting outputs. Save the input, agent output, tool calls, source material used, timestamp, reviewer actions, affected records, and any customer-facing message. The AI Agent Audit Trail NZ guide explains the logs that should exist before workflows expand.

3. Identify the business owner and affected workflow

Name the person responsible for the incident decision. In a small business, this may be the owner or operator. In a larger team, it may be the sales manager, operations lead, data owner, finance owner, or website owner. The technical supplier can help investigate, but the business owner decides the commercial response.

4. Contain the impact

Decide what needs correction now. That may include removing a draft, updating a CRM note, correcting a report, replacing a website section, notifying a staff member, or contacting a customer with a clear correction. Avoid over-correcting if the impact is limited, but do not hide a customer-facing error.

5. Find the failure point

Look for the practical cause: wrong source, stale page, missing approval gate, broad permission, unclear prompt, bad input, failed integration, tool timeout, no owner review, or a reviewer who was overloaded. Most incidents are workflow design problems, not just model problems.

6. Decide the restart rule

Do not restart because the immediate problem has been patched. Define the restart condition: source corrected, permission reduced, approval gate added, escalation rule rewritten, tests passed, and owner accepted the change. If you have not tested the fix, keep the workflow paused or draft-only.

Common AI agent incident examples

These examples are starting prompts, not legal, privacy, HR, or financial advice. Use them to decide where your own stop and response rules belong.

Sales or CRM incident

A sales agent changes lead status, deal value, next action, or follow-up priority incorrectly. Pause write access, preserve the before-and-after CRM record, check the source used, correct the pipeline record, and decide whether future CRM updates must stay recommendation-only.

Inbox or customer reply incident

An inbox agent drafts or sends a reply that is too confident, uses the wrong tone, misses a complaint, or promises something outside the approved offer. Stop sending, keep the message thread, assign a person to review the customer impact, and tighten the rule for complaints, refunds, pricing, and sensitive data.

Content or website incident

A content agent publishes or prepares copy with unsupported proof, stale pricing, wrong internal link, broken CTA, or a claim the business cannot stand behind. Remove or correct the content, preserve the previous version, check source pages, and require approval before publishing resumes.

Reporting or operations incident

A reporting agent summarises incomplete data, mislabels a trend, or recommends an action from a failed tool call. Pause the report distribution, mark the affected report as corrected, identify missing data, and add a rule that low-confidence or failed-source summaries escalate before decisions are made.

How to prepare before something goes wrong

Incident response works best when the rules already exist. Waiting until the first mistake creates confusion and slows the correction.

Define who can stop the agent

Every live workflow needs a named stop authority. This person should be able to pause the trigger, remove permissions, change the workflow to draft-only, or ask the implementation partner to disable the run.

Write rollback and correction steps

For each workflow, define the likely rollback path. Can a CRM change be reverted? Can a website page be restored? Can an email be corrected? Can a report be reissued? Can tool access be removed quickly?

Test the response plan before launch

Use AI Agent Acceptance Testing NZ to check not only whether the agent can perform the happy path, but whether the business knows what to do when the agent stops, fails, or produces the wrong output.

How an AI Agent Assessment maps incident response before build

The AI Agent Assessment turns incident response into a practical workflow map before implementation expands. For one workflow, we identify:

  1. What the agent may read, draft, recommend, update, send, or publish.
  2. Which actions need approval before they create consequences.
  3. Which conditions force escalation or pause the workflow.
  4. What logs prove what happened.
  5. Who owns review, correction, restart, and rollback.

That map helps the business decide whether the first build should be read-only, draft-only, approval-gated, or not built yet.

Frequently asked questions

What is AI agent incident response?

AI agent incident response is the process a business follows when an AI agent makes, prepares, sends, updates, publishes, routes, or recommends something wrong. It covers pausing the workflow, preserving evidence, correcting the affected work, finding the failure point, and deciding whether the agent can restart.

What should a business do first when an AI agent makes a mistake?

Pause the workflow first so the mistake cannot repeat. Then preserve the evidence, identify the affected records or messages, assign a business owner, contain the impact, and review the failure before restarting the agent.

Who should own AI agent incident response?

The business should own incident response. A technical partner can investigate integrations, prompts, permissions, and logs, but the business owner or workflow owner should decide customer corrections, commercial impact, restart timing, and approval rules.

Should an AI agent be restarted after an incident?

Only restart after the failure point has been corrected and tested. If the cause is unclear, keep the workflow paused, read-only, or draft-only until source material, permissions, approval gates, escalation rules, and logs are reviewed.

Next step

Do not wait for the first mistake to decide who can stop an agent. Define the pause, evidence, correction, owner, and restart rules before automation touches live work.