nvswitch

**NVSwitch** is the **switching fabric that interconnects multiple GPUs with high-bandwidth non-blocking communication inside accelerated systems** - it provides uniform, scalable GPU-to-GPU bandwidth and simplifies topology for large collective workloads. **What Is NVSwitch?** - **Definition**: Dedicated switch ASIC that routes NVLink traffic among many GPUs with high aggregate throughput. - **Topology Benefit**: Creates near all-to-all connectivity so each GPU can communicate efficiently with others. - **System Role**: Enables dense accelerator systems where communication patterns are intensive and dynamic. - **Performance Outcome**: Reduces hop-related bottlenecks and improves collective operation consistency. **Why NVSwitch Matters** - **Scalability**: Supports larger GPU groupings without severe intra-node communication penalties. - **Load Balance**: Uniform paths reduce topology hot spots in synchronized training workloads. - **Parallel Efficiency**: Faster intra-node collectives improve end-to-end step throughput. - **Design Simplicity**: Abstracts complex point-to-point wiring into manageable fabric architecture. - **System Throughput**: High-bandwidth switching helps maintain high GPU utilization at scale. **How It Is Used in Practice** - **Fabric-Aware Scheduling**: Place tightly coupled jobs on NVSwitch-connected node groups. - **Collective Stack Tuning**: Configure communication libraries to exploit available switch bandwidth. - **Health Telemetry**: Track link counters and congestion signals to prevent silent performance erosion. NVSwitch is **the intra-node network core for modern dense GPU platforms** - strong switching performance is essential for predictable large-model training efficiency.