Enterprise
Overview
Normally the AI's reply goes straight to the visitor. With the Output Classifier on, a second, independent model reads every reply first and decides whether it is safe to send: did the bot get tricked into breaking its role, is it giving regulated advice, is it engaging with a topic you have forbidden? A flagged reply never reaches the visitor as-is — it is rewritten once, and if the rewrite is still flagged, your fallback message is shown instead.
How It Works
- The AI answers as usual - nothing about the main model changes
- The classifier reads the draft - a fast second model checks it against your enabled categories
- Flagged replies get one rewrite - the violation is fed back to the main model, which writes a corrected reply that is checked again
- Fallback as the last resort - if the rewrite is still flagged, the visitor sees your safe fallback message instead
Draft reply
Flagged
Visitor sees
Corrected reply
What It Checks
- Persona breaks and prompt injection - always on: the bot obeying instructions hidden in a visitor message, revealing its own rules, or dropping its support role
- Medical advice - diagnosis, treatment or dosage recommendations; product information stays allowed
- Legal advice - interpreting law for the visitor's situation; stating your own policies stays allowed
- Financial advice - investment or personal finance recommendations; your own prices and fees stay allowed
- Your forbidden topics - a free-text list you write, one topic per line — this is where you define what is sensitive for your business
The Incident Log
Every flag is recorded on the settings page: the category, the classifier's reason, the blocked draft and what the visitor saw instead. It is both your tuning tool for false positives and the audit trail you can show your own compliance team. Incident content goes through PII Redaction like every stored surface, and under Zero Retention Mode only the metadata is kept — no message content.
If the Classifier Itself Fails
A second model means a second thing that can time out. You choose what happens then:
- Fail open (default) - the unchecked reply is delivered; availability wins
- Fail closed - the fallback is shown instead, for sites where an unchecked reply is worse than no reply
Good To Know
- It only acts on the reply, never the question - if your bot already refuses or answers safely, nothing is flagged, and that is correct. The classifier is a safety net for the rare reply that slips through, not a check on what the visitor asked. Trying to jailbreak a well-behaved bot will usually show no flag because the bot handled it on its own.
- Latency - the check adds roughly half a second to every reply, and a flagged reply pays for a full rewrite on top
- Not a guarantee - this is one model judging another; it is an additional independent layer, not an absolute barrier
- Test chat shows verdicts - the dashboard test chat enforces exactly like the live widget and tells you when a reply was flagged, so you can try to trick your own bot
- Write the fallback in your visitors' language - it is shown verbatim; the built-in default is English
- Works alongside your AI Instructions - instructions steer the first model, the classifier catches what slips through; use both
Note: The Output Classifier is part of an Enterprise agreement. Email [email protected] and we will walk you through it.