A company has a customer service application that uses Amazon Bedrock to generate personalized responses to customer inquiries. The company needs to establish a quality assurance process to evaluate prompt effectiveness and model configurations across updates. The process must automatically compare outputs from multiple prompt templates, detect response quality issues, provide quantitative metrics, and allow human reviewers to give feedback on responses. The process must prevent configurations that do not meet a predefined quality threshold from being deployed.
Which solution will meet these requirements?
Show answer and explanation
Correct answer: B
Bedrock evaluation jobs run the competing prompt templates and model configurations against a consistent custom prompt dataset, producing comparable quality measurements and outputs for review. Triggering those jobs from CodePipeline whenever templates change makes evaluation repeatable across updates. The pipeline gate then prevents deployment unless the measured result exceeds the predefined quality threshold.