OpenAI launched Presence on July 22 with policies, standard operating procedures, guardrails, approved actions, simulations, evaluations, and managed improvement around production voice and chat agents. The useful signal is operational: a capable model does not tell a support team who owns an answer, what happens during an outage, or when the chatbot must stop.
You can close that gap with a one-page AI support SOP. Complete this control sheet before the chatbot becomes a primary support path:
| SOP field | Decision to record | Example |
|---|---|---|
| Purpose | The customer job the chatbot exists to complete | Answer public product and shipping questions |
| Allowed work | Intents it may handle end to end | Explain published policy; collect a support request |
| Stop points | Intents it must not decide | Refund exceptions; account recovery; safety advice |
| Evidence | Sources allowed for each answer class | Current help center; approved Q&A; live account API |
| Escalation | Destination, trigger, and required packet | Billing queue after identity and invoice are verified |
| Incident mode | Reduced behavior when a dependency fails | Public FAQ only; disable account-specific claims |
| Owners | Named people for content, operations, and incidents | Support ops, policy owner, on-call engineer |
| Review rhythm | What gets checked and how often | Daily alerts; weekly transcript sample; release review |
| Success measures | Customer outcomes and control failures | Resolution, useful handoff, unsupported-claim rate |
| Change record | Version, approver, evidence, and rollback | support-sop-2026-07-27.1 with test report |
Keep the detailed prompts, test cases, and policy documents elsewhere. The SOP should point to their current versions and tell a person what to do when normal behavior stops being safe.
Make the SOP a Decision Document
An SOP becomes useless when it merely describes the chatbot: “The assistant answers questions and escalates when necessary.” Every important word is undefined. Which questions? What counts as necessary? Where does an escalation go? What information follows it? Who notices if that route breaks?
Write each rule as an observable decision:
- Answer when the request is public, the source is approved, and no customer-specific judgment is required.
- Ask when one missing fact can safely determine the next step, such as the customer’s country for a shipping estimate.
- Verify before using account-specific data, entitlements, orders, invoices, or identity.
- Escalate when the request needs an exception, professional judgment, privileged access, or a human-owned decision.
- Block requests for prohibited disclosures, destructive actions, or work outside the support channel’s mandate.
Those verbs make tests possible. For “Can you refund an annual plan after 18 days?”, the expected result might be “verify the account, explain the published rule, and prepare a billing review.” “Be careful with refunds” cannot be tested consistently.
Assign the decision to the right owner as well. The chatbot can gather facts and explain policy. Authentication proves identity. Business logic checks eligibility. A person approves an exception. The chatbot approval workflow shows how to separate those jobs when an action changes money, access, privacy, or another customer-visible state.
Define Evidence Before Wording
A polished answer can still be wrong. The SOP therefore needs an evidence rule for every answer class before it needs tone guidance.
Use a source order such as:
- Live system state for account, order, inventory, or appointment facts.
- Approved Q&A for exact policy answers that should not be synthesized.
- Canonical help content for public explanations and procedures.
- Human review when sources conflict, are missing, or require an exception.
The model’s general knowledge is not an acceptable source for your price, cancellation terms, warranty, service area, or current product behavior. Write that exclusion down.
Source ownership belongs in the same rule. Record the canonical URL or document, its business owner, its last review date, and the intents it governs. When a policy changes, the team can find every affected answer instead of waiting for a customer to expose the stale one.
For exact answers, Q&A pairs are often more reliable than hoping retrieval ranks the right paragraph. For broader content, the chatbot training guide explains how websites, documents, Q&A pairs, and text sources fit together. The SOP’s job is to state which source wins when two of them disagree.
Specify a Handoff That Continues the Work
“Contact support” is an exit, not an escalation procedure. A useful handoff moves enough verified context that the customer does not restart the conversation.
Require a packet with:
- the customer’s request in one sentence;
- identity state, without copying unnecessary sensitive data;
- relevant product, order, plan, or invoice identifiers;
- the approved source or policy version consulted;
- what the chatbot already tried;
- the exact reason automation stopped;
- the requested next decision and owning queue;
- the customer-facing expectation for response time.
The destination must be concrete. “Human team” is not routable. Name the queue, inbox, channel, ticket type, or on-call role, plus the fallback destination if the primary route fails.
Customer copy should match the internal state. If no ticket was created, the chatbot must not say “your case is with our team.” If a request is pending approval, it must not imply the action is complete. The AI-to-human handoff guide goes deeper on the experience; the SOP makes its minimum packet and routing rules mandatory.
Worked Incident: A Refund Question During an Outage
Assume a customer asks for a refund while the account API is returning timeouts. The public policy says annual-plan refunds require account verification and billing review. The chatbot can retrieve the policy, but it cannot verify the invoice or submit a review safely.
A weak interaction turns the general rule into an account-specific promise:
Customer: I renewed last week by mistake. Can you refund it? Chatbot: Yes, you are within the refund window. I have sent this to billing.
Neither claim is proven. The SOP should produce a narrower result:
Customer: I renewed last week by mistake. Can you refund it? Chatbot: Annual-plan refund requests require account verification and billing review. Account lookup is temporarily unavailable, so I cannot confirm your invoice or submit the request yet. You can try again later or contact billing at [email protected]. Include the invoice number, but do not send payment card details.
The corresponding incident record might be:
incident: support-api-2026-07-27-02 dependency: account-api detected_at: 2026-07-27T10:14:00Z affected_work: - invoice verification - refund review submission allowed_mode: - explain public refund policy - provide verified billing contact blocked_claims: - customer eligibility - request submitted - refund approved restore_when: - account lookup test passes - review submission test passes - one synthetic end-to-end case is reconciled owner: support-on-call
This record gives the chatbot a smaller operating envelope instead of a generic outage apology. It also defines restoration evidence. A green provider status page alone does not prove that your identity, lookup, and submission path works end to end.
Give Incidents a Reduced-Service Mode
List the dependencies behind each support job: model provider, retrieval index, authentication, CRM, order system, ticketing destination, email, webhook, and any action API. Then define what the chatbot may still do when each one fails.
During a retrieval outage, it may show contact routes but should not reconstruct policy from model memory. During an authentication outage, it may explain public procedures but should not discuss an account. During a ticketing outage, it may offer a verified fallback inbox but should not claim a ticket number exists.
The SOP also needs stop conditions. Examples include:
- any unsupported pricing, policy, or eligibility claim;
- an action reported as complete without a reconciled result;
- escalation packets failing to reach their destination;
- repeated retrieval failures on a high-volume intent;
- a sharp increase in customer repetition after a change.
Name who can activate reduced-service mode, how customers are informed, which logs are preserved, and who authorizes restoration. Otherwise, the safest available behavior may sit unused while teams debate authority during the incident.
Run the SOP on a Real Cadence
Operational ownership needs calendar time, not a name in a document.
Every day, review alerts and broken routes. Look for action failures, provider errors, handoff delivery failures, blocked high-risk attempts, and sudden changes in fallback volume. Daily work should be exception-driven, not a full transcript read.
Every week, sample outcomes. Review successful answers, escalations, abandoned conversations, negative feedback, and long loops. Include some apparent successes; a confident wrong answer may never trigger a complaint or fallback. Turn repeated failures into source fixes, Q&A updates, routing changes, and regression tests.
On every material change, run the release gate. A new model, prompt, source, policy, tool, credential, or routing rule can alter behavior. Record the hypothesis, affected intents, test evidence, rollout boundary, stop condition, and rollback target. The chatbot change-management process provides the release card; reference its approved result from the SOP version.
After every incident, update one control. Add the failed conversation to the test set, clarify an ownership gap, tighten a stop condition, or improve reduced-service copy. An incident review that changes nothing leaves the next shift with the same trap.
Measure Whether the SOP Was Followed
Message volume and average response time do not reveal whether the operating procedure worked. Add control metrics that can lead to a specific correction.
| Metric | Formula | What a miss should trigger |
|---|---|---|
| Evidence coverage | Sampled factual answers with approved evidence / sampled factual answers | Fix source mapping or block unsupported intents |
| Useful handoff rate | Escalations with complete required packet / total escalations | Repair fields, verification, or routing |
| False-completion rate | Actions claimed complete without reconciled success / action conversations | Stop the action and fix result handling |
| Reduced-mode compliance | Affected conversations following incident rules / affected conversations sampled | Tighten runtime controls and incident tests |
| Change escape rate | New production failures caused by a release / relevant conversations | Roll back and expand the release suite |
Suppose a weekly sample contains 200 conversations. Thirty-six escalated, and 31 included every required handoff field. The useful handoff rate is 31 / 36 = 86.1%. If the target is 95%, inspect the five misses by field. Missing invoice IDs call for better collection or validation; missing escalation reasons call for clearer routing logic. “Train the model more” is too vague to resolve either defect.
Use conversation review to improve the system, not to grade individual phrases. The AI chatbot QA loop turns those findings into repeatable test cases so the same operational miss cannot quietly return.
Keep the Runbook Smaller Than the System
The SOP should stay short enough that a support lead can use it during a live problem. Link to versioned policies, test suites, prompts, dashboards, and incident procedures rather than copying them into one document that becomes stale everywhere at once.
Review the runbook whenever an owner, source, integration, customer promise, or escalation destination changes. Then test it with a tabletop scenario: remove one dependency, choose a real customer request, and ask the on-duty team to follow the written path. Any decision that requires unwritten tribal knowledge belongs in the next version.
Reliable AI support comes from making the operating boundary legible: what the chatbot may do, what evidence it needs, who takes over, how behavior shrinks during failure, and which proof lets normal service resume.
In Agentkit, conversation logs and analytics provide evidence for the review cadence, while Q&A pairs let teams pin approved answers for policy-sensitive questions.
No credit card required.



