User Intent Change

Learn how to measure if users are using your agent system for different intents across multi-turn conversation

User Intent Change checks if users are using your agent system for different intents across multi-turn conversations.

User Intent Change is a binary evaluation metric, and is defined as a significant shift in the user’s primary conversational goal or workflow during a session, relative to their initial stated intent.

This is a boolean metric, returning a confidence score that the user intent has changed significantly. The score ranges from 0% (no confidence the user intent has changed) to 100% (complete confidence that the user intent has changed).

User Intent Change at a glance

Property	Description
Name	User Intent Change
Category	Agentic AI
Can be applied to	Session
LLM-as-a-judge Support	✅
Luna Support	❌
Protect Runtime Protection	❌
Value Type	Boolean shown as a percentage confidence score

When to use this metric

When to Use This Metric

User Intent Change is useful when working with multi-step chat bots or other AI systems with multiple user interactions

Score interpretation

Expected Score: 80%-100%.

0

60%

100%

Poor

Fair

Excellent