How Quality Studio Works
Flag a conversation
While reviewing conversations, flag any problematic response — the entire conversation or a specific message.
Create an issue
Quality Studio creates a tracked issue linked to that conversation. Use AI Issue Creation to let AI suggest the title, description, tags, and severity automatically.
Dashboard Layout
The dashboard focuses on trend and quality signals rather than a raw issue table:| Panel | Description |
|---|---|
| Issue Trends | Created vs. resolved issues over the last seven days |
| Issues Breakdown | A segmented chart by tag, severity, or status |
| AI Insights | Generated summary, key findings, and recommendations |
| Agent Health | Open and recently resolved issue counts per agent |
Issue Trends
An area chart visualizes issue volume over time with two series:- Created — new issues opened per period
- Resolved — issues closed per period
Issues Breakdown
A tabbed panel lets you slice issue data three ways:- By Tag
- By Severity
- By Status
Shows the top 5 issue tags by count. Tags categorize issues by type — for example,
wrong-information, missed-intent, tone-issue, or knowledge-gap. Use this view to spot recurring problem areas.Agent Health
The Agent Health panel shows quality metrics per agent:| Column | Description |
|---|---|
| Agent | Agent name and avatar |
| Open Issues | Number of unresolved issues |
| Resolved This Week | Issues resolved in the current week |
AI Insights
Quality Studio can generate AI-powered insights on demand. Click the refresh/generate control in the AI Insights card to analyze recent issue data and surface:- Trends — Patterns in issue creation and resolution over time
- Alerts — Emerging problems that may need immediate attention
- Patterns — Common themes across multiple issues
- Recommendations — Suggested actions to improve agent quality
Next Steps
Quality Issues
View, filter, and resolve individual quality issues
Conversations
Review conversations and flag problematic responses