Free AIP-C01 Web TestEngine Demo

Q8 Single choice

Before approving a question-answering configuration, the team must measure factual support, relevance, completeness, and usefulness across different customer segments. Which evaluation design provides the strongest evidence?

A
Use representative held-out cases, separate task metrics, calibrated human rubrics, and segment-level results.
B
Test a public benchmark, combine all dimensions into one average score, and approve the highest-scoring configuration.
C
Test examples used during development, apply one lexical-overlap metric, and review only responses below its threshold.
D
Test a small random sample, ask reviewers for an overall preference, and report only the aggregate win rate.

AIP-C01 Web TestEngine demo