Skip to main content
The Issues page is where you manage every quality issue across your agents — from initial flagging through resolution. Create issues manually, from flagged conversations, or with AI assistance. Each issue tracks the full lifecycle from flagging to resolution. Access: Navigate to Quality Studio > Issues in the main menu

Views

Switch between views from the view menu in the page header:
A table grouped by status with collapsible sections. Each row shows:
ColumnDescription
SeverityIcon indicating the severity level
IDShort identifier for the issue
StatusCurrent status icon
TitleIssue title
AgentAgent avatar and name
TagsFirst tag displayed as a badge
AssigneeAssigned team member, or unassigned

Use the page header to search issue titles and descriptions. Use the assignee chips to switch between All issues, My issues, and Unassigned.

Creating Issues

You can create an issue in three ways:

Manual Creation

Click New Issue and fill in the title, description, agent, severity, tags, and optional assignee.

From a Flagged Conversation

When you flag a conversation or message, you are prompted to create a quality issue linked to that specific interaction. The platform automatically attaches the conversation context.

AI Issue Creation

When creating an issue from a flagged conversation, enable AI Issue Creation to let AI analyze the conversation and suggest:
  • Title — A concise summary of the problem
  • Description — What went wrong in the conversation
  • Tags — Suggested issue type (e.g., wrong-information, missed-intent, tone-issue, knowledge-gap)
  • Severity — Recommended severity level based on impact
  • Assignee — Suggested team member based on the issue type
Review and adjust the AI suggestions before saving. The AI provides a starting point — you have full control over the final issue.

Issue Statuses

Every issue progresses through three statuses:
StatusDescription
TodoCreated and awaiting triage or action. All new issues start here.
In ProgressA team member is actively working on the issue.
DoneYour team resolved the issue.

Severity Levels

SeverityWhen to Use
CriticalImmediate attention needed — compliance violations, consistently wrong information, failed transfers
HighSignificant impact on customer experience or business outcomes
MediumNoticeable quality concern that should be addressed soon
LowMinor issue or improvement opportunity

Issue Tags

Tags categorize the type of problem. Common tags include:
TagDescription
wrong-informationAgent provided incorrect facts or data
missed-intentAgent failed to understand what the caller wanted
tone-issueAgent’s tone was inappropriate for the situation
goal-failureAgent failed to achieve its conversation goal
hallucinationAgent made up information not in its knowledge base
handoff-failureTransfer to a human agent failed or the agent mishandled it
knowledge-gapAgent lacked information needed to answer the question
off-topicAgent’s response was off-topic or irrelevant
formattingResponse formatting or presentation issue
prompt-issueThe agent’s prompt caused undesired behavior
You can also create custom tags to match your needs.

Issue Detail View

Click any issue to open the full detail view.

Main Content

  • Title — Issue summary
  • Description — Detailed explanation of what went wrong
  • Expected Behavior — What the agent should have done instead, when provided
  • Conversation Link — Direct link to the related conversation, when the issue was created from a conversation
  • Parent Issue — Link to a parent issue if this is a sub-issue
  • Sub-issues — Child issues broken down from this one
  • Linked Issues — Related issues connected for cross-referencing

Activity Timeline

A chronological log of everything that has happened on the issue — status changes, comments, assignments, and edits. Add comments using the input at the bottom (submit with Cmd+Enter). The sidebar displays and allows editing of issue properties:
PropertyDescription
StatusTodo, In Progress, or Done
SeverityCritical, High, Medium, or Low
AssigneeTeam member responsible for the issue
AgentThe agent associated with the issue
TagsEditable list of tags
CreatedWhen the issue was created

Keyboard Shortcuts

Use keyboard shortcuts in the detail view for fast triage:
ShortcutAction
S, then 1/2/3Set status to Todo / In Progress / Done
P, then 1/2/3/4Set severity to Low / Medium / High / Critical
A, then 09Clear assignee or assign to a team member

Resolution Types

When marking an issue as done, select a resolution type to categorize what was fixed:
Resolution TypeDescription
Prompt UpdateYou updated the agent prompt
Knowledge UpdateYou added or corrected knowledge base content
Settings ChangeYou adjusted the agent configuration
Guard Rail AddedYou added a guardrail to prevent the behavior
Test Case CreatedYou added a test case to catch future regressions
Dismissed (Edge Case)You dismissed the issue as an edge case
OtherResolution does not fit other categories

Next Steps

Quality Studio Dashboard

Monitor trends, breakdowns, and agent health metrics

Conversation Detail

Review conversations and flag problematic responses

Agent Editor

Update your agent’s prompt, knowledge, and settings

Prompt Engineering

Improve your agent’s prompt with advanced techniques