Overview
Monitor Sagent health trends with widgets, locale filters, and time ranges.
Use Overview to monitor your Sagent's health over time. It helps you spot quality drops, tool issues, and unusual conversation patterns.
How to use Overview
Monitoring widgets
Conversation Health
This widget shows week-over-week score changes by quality dimension. It uses a line chart over time.
Use it to spot stable, improving, or declining quality. Dips often follow prompt or catalogue changes.
The score is a quality signal from monitored conversations. It is not a shopper satisfaction score or purchase outcome. Compare periods with similar locale coverage and enough conversations.
Average Tool Response Time
This widget shows response-time trends for each tool. It uses a line chart over time.
Use it as a health check for latency issues. Watch for sudden dips or spikes after deployments.
The metric comes from tool activity during Sagent conversations. It measures tool responsiveness, not the full shopper wait time. No data can mean no eligible tool activity occurred.
Flagged Conversations
This widget shows flagged conversations over time. It uses a stacked bar chart by flag type.
Use it to identify increasing risk or off-path behavior.
Flags come from monitoring classifications. A flag identifies a review signal. It does not prove that Sagent gave an incorrect answer.
Current flag categories are:
Guardrail trigger
Customer support
Small talk
Average Tool Usage
This widget shows how often each tool succeeds in conversations. It uses a line chart per tool.
Use it to catch unexpected drops in tool usage. This can show when part of the experience is used less.
The metric comes from successful tool use in selected conversations. A lower average can reflect changed shopper needs. It does not necessarily indicate tool failure.
Read trends effectively
Start with these checks:
Compare the current period with the previous one.
Look for changes across more than one widget.
Match the shift to a product or configuration change.
For example:
Conversation Health drops and Flagged Conversations rise — review recent updates and conversation patterns.
Tool Response Time worsens and Tool Usage drops — check whether response speed affects the experience.
Tool Usage drops with stable response time — review whether the conversation flow changed.
Filters and defaults
Monitoring includes two primary filters:
Locale
Time range
The default locale is Global - All.
Use the same date range and locale when comparing widgets.
Best practices
Review Monitoring regularly, not only when something breaks. Weekly reviews work well for trend tracking.
Use it after every major Sagent update.
When you see a change, compare:
Locale
Time range
Recent Sagent updates
Last updated
Was this helpful?
