NVIDIA-Certified Associate AI Infrastructure and Operations

NVIDIA NIMs (NVIDIA Inference Microservices) are pre-built, GPU-accelerated microservices with standardized APIs, designed to simplify and accelerate AI model deployment across diverse environments-clouds, data centers, and edge devices. Their key value lies in enabling fast, turnkey inference without requiring custom deployment pipelines, reducing setup time and complexity. While community support and SDK deployment may be tangential benefits, they are not the primary focus of NIMs.
(Reference: NVIDIA NIMs Documentation, Overview Section)

Power Usage Effectiveness (PUE) is the standard metric for evaluating energy efficiency in data centers, comparing total facility energy to IT equipment energy.

Remote Direct Memory Access (RDMA) reduces CPU utilization and latency through network adapters with hardware offloading. These adapters handle data transfers directly between memory locations, bypassing CPU-intensive operations like memory copies and protocol processing. Larger buffers and software like Magnum I/O may enhance performance, but hardware offloading is the core RDMA feature delivering these benefits. (Reference: NVIDIA Networking Documentation, Section on RDMA Offloading)

The Baseboard Management Controller (BMC) manages power and thermal telemetry, ensuring optimal cooling and uptime for DGX-class systems in AI data centers.

Artificial Intelligence (AI) is the overarching field encompassing techniques to mimic human intelligence.
Machine Learning (ML), a subset of AI, involves algorithms that learn from data. Deep Learning (DL), a specialized subset of ML, uses neural networks with many layers to tackle complex tasks. This hierarchical relationship-DL within ML, ML within AI-is the correct differentiation, unlike the reversed or conflated options. (Reference: NVIDIA AI Infrastructure and Operations Study Guide, Section on AI, ML, and DL Definitions)

OpenSM (Open Subnet Manager) is essential for InfiniBand networks, managing the fabric by discovering topology, configuring switches and host channel adapters (HCAs), and handling routing. Without it, the fabric cannot operate. Verbs is an API for RDMA, and MPI is a communication protocol, but OpenSM is the critical software component for functionality. (Reference: NVIDIA Networking Documentation, Section on InfiniBand Subnet Management)

On-premises infrastructure offers a key advantage in ensuring data security and sovereignty, as organizations retain direct control over hardware and data, facilitating compliance with strict regulations (e.g., GDPR). Cloud solutions excel in scalability and lower upfront costs, but on-prem provides unmatched authority over sensitive data, outweighing remote management ease in security-critical scenarios. (Reference: NVIDIA AI Infrastructure and Operations Study Guide, Section on On-Prem vs. Cloud Infrastructure)

The nvidia-smi tool provides detailed GPU statistics including memory, temperature, utilization, and process information for monitoring GPU health.

NVIDIA vGPU (Virtual GPU) software enables GPU virtualization by partitioning a physical GPU into multiple virtual instances, assignable to virtual machines or containers for accelerated workloads. Horizon is a VMware product, and "virtGPU" isn't an NVIDIA offering, confirming vGPU as the correct solution.
(Reference: NVIDIA vGPU Documentation, Overview Section)

Containers (e.g., Docker) encapsulate AI applications with their dependencies, ensuring consistent execution across diverse environments-from development laptops to production clusters-without manual reconfiguration. They don't inherently improve model accuracy, generate datasets, or boost GPU speed, focusing instead on portability and reproducibility.(Note: The document incorrectly lists A; B is correct per
NVIDIA standards.) (Reference: NVIDIA AI Infrastructure and Operations Study Guide, Section on Containers in AI Development)