NCA-AIIO Exam Dumps : NVIDIA-Certified Associate AI Infrastructure and Operations

GPU utilization is defined as the percentage of time the GPU’s compute engines are actively processing data, reflecting its workload intensity over a period (e.g., via nvidia-smi). It’s distinct from memory usage (a separate metric), core counts, or maximum runtime, providing a direct measure of compute activity.

(Reference: NVIDIA AI Infrastructure and Operations Study Guide, Section on GPU Monitoring)

The correct answer is B because distributed AI training performance depends heavily on high-bandwidth, low-latency inter-node communication. NVIDIA DGX SuperPOD reference architecture states that InfiniBand “continues to evolve and lead data center network performance,” with NDR InfiniBand providing “400 Gbps per direction” and “extremely low port-to-port latency.” It also notes that InfiniBand provides additional performance-optimization features, including adaptive routing and collective communication with NVIDIA SHARP.

NVIDIA Network Operator documentation also states that it delivers “high-throughput, low-latency networking for scale-out, GPU computing clusters” and that RDMA supports memory-to-memory transfers that “bypass the CPU and kernel networking stack,” with support for InfiniBand and RoCE protocols. This directly supports deploying a lossless InfiniBand or RoCE fabric for distributed training traffic such as all-reduce communication.

Why the other options are incorrect: Wi-Fi is unsuitable for high-performance multi-rack GPU training communication. Stateful firewalls and deep-packet inspection between training nodes would add latency and bottlenecks. Adding switch ports without fixing oversubscription and latency does not solve distributed all-reduce scaling inefficiency.

In a resource-constrained AI cluster, a job scheduler (e.g., Slurm) efficiently allocates limited resources (GPUs, CPUs) to workloads, optimizing utilization and job execution time. It prioritizes based on policies, not just first-come-first-served, and doesn’t add resources or run all jobs simultaneously, focusing instead on resource optimization.

(Reference: NVIDIA AI Infrastructure and Operations Study Guide, Section on Job Scheduling Importance)