Free AI-300 Web TestEngine Demo

Q2 Single choice

An organization runs a customer-facing generative AI application built by using Microsoft Foundry. The application uses multiple prompts linked to multiple workflows to generate responses in production.

The application occasionally returns incomplete responses. The model call succeeds, but the final message sometimes stops early.

The issue cannot be reproduced reliably in development.

You need to identify where and why response generation is terminating early in production.

Which approach should you use?

A
Run a pre-release evaluation workflow to score groundedness and relevance on a test dataset.
B
Enable tracing and logging so that each workflow can be inspected.
C
Increase max_tokens and temperature to reduce the chance of early termination.
D
Replace the deployed model with a smaller model to reduce variability across responses.

AI-300 Web TestEngine demo