What Is an AI Runbook? (2026): The Page the On-Call Opens

An AI runbook is the page an on-call opens for one model-backed feature: who owns it, how to tell it is unhealthy, which flag or key turns it off, what to tell customers, and which prompt version is live. A chat transcript is not a runbook. A runbook has an owner and a date, and it is updated when the feature changes.

The path that uses that page during a bad day is what AI incident response is. The place a fact is allowed to live is what a system of record for AI is. The checks the page should point at are what AI observability is and what AI SLA monitoring is.

Prices are US list prices excluding tax from directory pages checked October 16, 2026. Published October 24, 2026. We did not score documentation tools.

What the page contains

Section	Written by	A model may
Owner and backup	You, with names that match the schedule	Not invent a rotation
What healthy looks like	The latency, error, or cost line you already monitor	Link the chart. It may not set the threshold
Turn it off	The feature flag or key name, and who has access	Repeat the name from this page
Customer note	Two sentences you approved in advance for “down” and “degraded”	Fill the time only from the incident
Prompt and tool list	The version number and the tools that feature may call	Not add a tool because it would be useful
Last tested	The date a person walked the steps	Not mark the test as done

flowchart TD
  feature["A model feature ships"] --> page["Write the runbook in the system of record"]
  page --> test["A person walks the off switch"]
  test --> live["The feature stays on"]
  live --> change{"Did the flag, prompt, or owner change?"}
  change -->|Yes| page
  change -->|No| live

The off switch is what AI feature flags are. The person who walks it is what human-in-the-loop AI is.

Where teams keep it

The wiki the on-call already opens. Notion AI Business is $20 a seat a month, which is the full AI tier on the directory card. Name one database for runbooks so they are not scattered across private pages. The invoice is Notion AI pricing explained.

A draft from a ticket. Claude Pro is $20 a month, or $17 billed annually. Paste the flag name and the owner. Ask for the headings in the table above, and delete anything that was not in the paste. The review is Claude review.

A shared team seat. ChatGPT Business is $20 a user a month billed annually, minimum two, or $25 monthly. A personal Plus seat at $20 can draft. It should not be the only copy of the off switch.

The edit before you publish the customer lines. Grammarly Pro is $12 a member a month billed annually. Short sentences survive a status page better than a generated paragraph.

Writing those customer lines as a habit is how to write a status update with AI. The people who keep production docs are on best AI tools for SRE teams and best AI tools for security ops docs.

A runbook that will fail you

It fails if the flag name is stale, if the only copy is in a chat, or if the customer note includes a cause you have not confirmed. It also fails if it includes steps for attacking the system. Keep those out. If the feature reads untrusted text, point at the control you already run, described at a policy level in what a prompt injection defense is.

Spend limits belong on the same page when money is part of “unhealthy.” That ceiling is what an AI budget cap is.

FAQ

How long should a runbook be?

One page for one feature. If the off switch takes more than a few numbered steps, the feature is harder to operate than the document can fix. Shorten the path, then the page.

Can one runbook cover every model?

No. Each feature has its own flag, owner, and customer impact. A single “AI runbook” becomes a list of links. The links are fine. The steps have to be specific.

How often should someone test it?

When the flag, the prompt version, or the owner changes, and on a schedule you can keep. A date in the future with no name is not a test. The eval habit for the model itself, separate from the on-call page, is what AI eval testing is.

Should the runbook live in the repo?

The off-switch steps can live next to the flag in the repo if that is where engineers look. The customer sentences can live in the wiki. Write down which copy wins when they disagree.

Last verified

October 16, 2026 for Notion, Claude, ChatGPT, and Grammarly prices named above. Published October 24, 2026.

Sources: Notion pricing, Claude pricing, ChatGPT pricing.

Published by Andrew for AI Tools Optimizer.

Notion AI is in the productivity and notes directory. Directory pages may use affiliate links. A purchase through them may earn us a commission at no extra cost to you.