NCP-AAI Web TestEngine demo

Conduct stress testing of individual microservices and guardrails to measure peak throughput and

determine theoretical performance limits of each module.

Use default configurations to establish a deployment baseline, focusing on stability before conducting

deeper performance profiling.

Create end-to-end latency waterfalls that capture guardrail overhead, NIM queuing delays, and

TensorRT optimization benefits while assessing overall pipeline efficiency.

Tune each component individually, focusing primarily on local performance metrics with secondary

attention to integration patterns.