← Blog
Automation & Agents

What Is an AI Prompt Router? (2026): This Kind of Ask, This Template

By Andrew · October 24, 2026

An AI prompt router is a table you wrote that sends a labeled kind of request to one prompt template and one model, before that model runs. The broader rule that sends an easy job to a cheaper model is what AI routing is. The second model you call after the first one fails is what AI fallback routing is. The single door in front of many models is what a model gateway is. This page is the row: an invoice question uses template B and model C. A password reset does not.

The instruction the user does not see, which a template may contain, is what a system prompt is. A shared prompt with an owner is what a prompt library is. The wording with a number on it is what prompt versioning is.

Prices are US list prices excluding tax from directory pages checked October 16, 2026. A live fetch of vendor pricing pages returned HTTP 401 on October 24, 2026, so this page stays on the directory record. Published October 24, 2026. The directory does not list a prompt-router fee, so this page does not invent one. We did not measure routing accuracy.

What a row contains

ColumnYou writeA router that will drift
LabelA kind of request you can detect with a rule you can explain“Looks hard”
TemplateA versioned prompt idWhatever the engineer remembers
ModelA model id, not a nickname“The best one”
ToolsThe tools that template may callEvery tool, because the router forgot
FallbackThe next row, or noneA silent jump to a stronger model
OwnerA person who can change the rowThe last person who edited a prompt
flowchart TD
  ask["A request arrives"] --> label{"Which label matches a rule you wrote?"}
  label -->|A known label| row["Use that row's template and model"]
  label -->|No label| unknown["Use the unknown-label row, or refuse"]
  row --> run["The model runs only with that row's tools"]
  run --> fail{"Did the call fail?"}
  fail -->|Yes, and the row names a fallback| next["The fallback row runs once"]
  fail -->|No| answer["Return the answer with the template id"]

The label has to be something you can check: a menu choice, a keyword list you maintain, or a classifier whose mistakes you have read. “The model will know” is not a label. Unknown requests need their own row, even if that row is a refusal. A router with no unknown row will force a billing question into the refund template.

Where the table is kept

The table in prose. Claude Pro is $20 a month, or $17 billed annually, when the router table is long enough to live in a Project and you want a change reviewed against the old rows. The review is Claude review.

A short table you paste. ChatGPT Plus is $20 a month when the router is a dozen rows and the habit is a project. The model may format a new row. It may not add a label you did not name. The review is ChatGPT review.

The code that reads the table. Cursor Plus is $8 a month, or $80 a year, when the router is a file in the repo. You review the diff. A generated row that points a refund intent at a draft-only template is a defect. The ladder is Cursor pricing explained.

The zap that branches. Zapier Professional is $19.99 a month billed annually. Paths can branch on a label you already set. Paths do not count as tasks. A path that calls a tool the row did not allow is the wrong branch, even if the task was cheap. The invoice is Zapier pricing explained.

A prompt that holds the line:

“Add a router row from the label, template id, model id, tools, and fallback I pasted. Do not invent a label. Do not add a tool. If the unknown-label row is missing from the table I pasted, write Unknown row missing and stop.”

What not to delegate

Do not let the router “pick the smartest model” with no row. Do not hide the template id from the log. When an answer is wrong, you need the row that produced it. Do not use the router to sneak a new prompt into production for everyone. A new template is a version. The slice that sees it first is still a canary if you choose to run one: what an AI canary release is.

FAQ

How is a prompt router different from a model gateway?

A gateway is the door: one place that holds keys, limits, and logs for many models. A prompt router is the table of which template and which model a labeled request uses. You can have a gateway and no router, which means every request gets the same prompt. You can have a router that still sends all of its rows through one gateway.

Can one request match two labels?

Your rule has to say which row wins, or the request goes to the unknown row. Two templates in one turn is a chain, and a chain needs its own check between steps. That pattern is what prompt chaining is.

Should the router call a model to choose the label?

Only when you have read the mistakes and the label set is too large for a list you maintain. The classifier is then its own row, with its own timeout and its own eval. A classifier you have never sampled will file refunds under billing forever.

Who changes a row?

The owner on that row. A prompt edit that does not change the template id will be invisible in the log. Version the template, then point the row at the new id.

Last verified

October 16, 2026 for Claude, ChatGPT, Cursor, and Zapier. Published October 24, 2026. Live pricing fetches returned HTTP 401 that day.

Sources: Claude pricing, ChatGPT pricing, Cursor pricing, Zapier pricing.

Published by Andrew for AI Tools Optimizer.

Cursor is in the coding directory. Directory pages may use affiliate links. A purchase through them may earn us a commission at no extra cost to you.

Disclosure: this post may contain affiliate links. If you buy through them we may earn a commission at no extra cost to you.

Tools mentioned in this post