Skip to main content
OpenBat can classify your chatbot’s responses into behavior categories like Helpful, Hallucinating, or Dodging. This guide shows you how to enable, disable, and customize these classifications.

Prerequisites

  • You have an active chatbot with analyzed conversations
  • You have Admin or Owner access to the chatbot

Toggle behavior detection

1

Navigate to analysis config

Go to /platform/{chatbotId}/analysis-config and click the Assistant Analysis tab.
Assistant Analysis tab with behavior classification toggles
2

Enable or disable the behavior toggle

Use the main Behavior toggle to turn assistant analysis on or off entirely.
3

Configure individual behaviors

Toggle each behavior classification independently:
BehaviorWhat it detects
HelpfulProvides useful, accurate responses
Yes-ManAgrees with everything without critical thinking
DodgingAvoids answering the question directly
Over-ApologizingExcessive unnecessary apologies
HallucinatingProviding incorrect or fabricated information
RedirectingSends user elsewhere instead of helping
VerboseUnnecessarily long responses
RoboticUnnatural, template-like responses
OtherCatch-all for unclassified behaviors
4

Save your changes

Changes are saved automatically when you toggle a behavior.

Add custom behaviors

If the built-in behaviors don’t cover your needs, create your own:
  1. Click + Add custom below the behavior list
  2. Enter a name and description for the new behavior
  3. OpenBat uses the description to guide AI detection, so be specific about what the behavior looks like in conversation
Write descriptions that include examples of what the behavior looks like. Instead of “Bad tone”, write “Responses that use condescending language, dismiss the user’s concern, or make the user feel unintelligent.”

Where behavior flags appear

Once enabled, behavior flags appear as clickable tags on assistant messages in the conversation detail view. They also aggregate in the Behavior alerts section on the Assistant Performance tab of the dashboard.

Next steps

Analysis config

Full reference for all analysis settings.

Customize prompts

Edit the AI prompts that power analysis.