An AI engineer is implementing an evaluation framework for their agent system. They want to measure whether…

Question

An AI engineer is implementing an evaluation framework for their agent system. They want to measure whether the agent asks for clarification when a customer's request is ambiguous rather than making assumptions. What evaluation metric captures this behavior?

Accepted Answer

B. Clarification rate — measuring the percentage of ambiguous inputs where the agent asks for clarification before acting, compared against a ground truth set of inputs that require clarification

Answer

A. Response accuracy — measuring whether final answers are correct

Answer

C. Response time — faster responses indicate the agent made assumptions

Answer

D. Token efficiency — lower tokens mean more decisive responses

Question 267