How to measure an AI agent: the six metrics that matter
Measure autonomous completion rate, escalation rate and reasons, error rate on an eval set, cost per completed task, latency and human hours returned. Report each per intent, never as an average, and pair the production numbers with an evaluation suite so a drop on the dashboard can be traced to a specific change.