> ## Documentation Index
> Fetch the complete documentation index at: https://docs.itellico.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Quality Studio

> Continuously improve your AI agents by tracking quality issues, analyzing trends, and using AI-powered insights

export const Screenshot = ({lightSrc, darkSrc, alt, caption, maxWidth = "880px"}) => {
  return <div style={{
    margin: "1rem auto",
    maxWidth,
    width: "100%"
  }}>
      <Frame>
        <img className="block dark:hidden" src={lightSrc} alt={alt} />
        <img className="hidden dark:block" src={darkSrc} alt={alt} />
      </Frame>
      {caption ? <p style={{
    marginTop: "0.5rem",
    fontSize: "0.875rem",
    color: "inherit",
    opacity: 0.8
  }}>
          {caption}
        </p> : null}
    </div>;
};

**Quality Studio** is where you steadily improve your agents. It combines issue tracking, trend analysis, and AI-powered insights to help you find problems, fix them, and confirm your agents are improving.

The workflow has three steps: flag problematic conversations, track issues through resolution, and watch your quality metrics improve.

**Access:** Navigate to **Quality Studio** in the main menu

<Screenshot lightSrc="/images/quality-studio__overview-dashboard-light.png" darkSrc="/images/quality-studio__overview-dashboard-dark.png" alt="Quality Studio dashboard showing issue trends chart, issues breakdown panels, and agent health metrics" />

## How Quality Studio Works

<Steps>
  <Step title="Flag a conversation">
    While reviewing conversations, [flag](/manage/conversations/detail#flagging-messages) any problematic response — the entire conversation or a specific message.
  </Step>

  <Step title="Create an issue">
    Quality Studio creates a tracked issue linked to that conversation. Use **AI Issue Creation** to let AI suggest the title, description, tags, and severity automatically.
  </Step>

  <Step title="Resolve the issue">
    Fix the problem — update the prompt, add knowledge, or adjust settings.
  </Step>

  <Step title="Track improvement">
    Monitor the dashboard to confirm issue volume is trending down and agent health is improving.
  </Step>
</Steps>

***

## Dashboard Layout

The dashboard focuses on trend and quality signals rather than a raw issue table:

| Panel                | Description                                          |
| -------------------- | ---------------------------------------------------- |
| **Issue Trends**     | Created vs. resolved issues over the last seven days |
| **Issues Breakdown** | A segmented chart by tag, severity, or status        |
| **AI Insights**      | Generated summary, key findings, and recommendations |
| **Agent Health**     | Open and recently resolved issue counts per agent    |

***

## Issue Trends

An area chart visualizes issue volume over time with two series:

* **Created** — new issues opened per period
* **Resolved** — issues closed per period

Use this chart to confirm your team is resolving issues faster than new ones appear. A widening gap between the two lines indicates a growing backlog that needs attention.

***

## Issues Breakdown

A tabbed panel lets you slice issue data three ways:

<Tabs>
  <Tab title="By Tag">
    Shows the top 5 issue tags by count. Tags categorize issues by type — for example, `wrong-information`, `missed-intent`, `tone-issue`, or `knowledge-gap`. Use this view to spot recurring problem areas.
  </Tab>

  <Tab title="By Severity">
    Breaks down issues across four levels: **Critical**, **High**, **Medium**, and **Low**. A spike in critical or high-severity issues signals that your team needs to act urgently.
  </Tab>

  <Tab title="By Status">
    Shows the distribution across **Todo**, **In Progress**, and **Done**. Helps you understand throughput and identify bottlenecks in your resolution process.
  </Tab>
</Tabs>

***

## Agent Health

The Agent Health panel shows quality metrics per agent:

| Column                 | Description                         |
| ---------------------- | ----------------------------------- |
| **Agent**              | Agent name and avatar               |
| **Open Issues**        | Number of unresolved issues         |
| **Resolved This Week** | Issues resolved in the current week |

Use this to quickly identify which agents need the most attention and which are improving.

***

## AI Insights

Quality Studio can generate AI-powered insights on demand. Click the refresh/generate control in the AI Insights card to analyze recent issue data and surface:

* **Trends** — Patterns in issue creation and resolution over time
* **Alerts** — Emerging problems that may need immediate attention
* **Patterns** — Common themes across multiple issues
* **Recommendations** — Suggested actions to improve agent quality

Quality Studio generates AI Insights on demand; they update as your issue data changes.

***

## Next Steps

<CardGroup cols={2}>
  <Card title="Quality Issues" icon="circle-exclamation" href="/manage/quality-studio/issues">
    View, filter, and resolve individual quality issues
  </Card>

  <Card title="Conversations" icon="messages" href="/manage/conversations/overview">
    Review conversations and flag problematic responses
  </Card>
</CardGroup>