The `nvidia-nccl-cu11` package provides the NVIDIA Collective Communication Library (NCCL) runtime binaries specifically compiled for CUDA 11. NCCL is a high-performance library for collective communication operations (e.g., all-reduce, all-gather, broadcast) across multiple GPUs, both within a single node and across multiple nodes. It is optimized for NVIDIA GPUs and high-speed interconnects like NVLink and InfiniBand. This package primarily serves as a backend dependency for deep learning frameworks (like PyTorch, TensorFlow) and other GPU-accelerated libraries that require NCCL's capabilities for distributed computing. The current version is 2.21.5, with frequent updates corresponding to new NCCL releases and CUDA versions.
pip install nvidia-nccl-cu11Verified import paths — ran on the pinned version, not inferred.
This quickstart demonstrates how to verify that NCCL is detected and its version reported by a common deep learning framework like PyTorch. The `nvidia-nccl-cu11` package provides the backend, and frameworks then expose its capabilities. This code checks for CUDA availability and attempts to retrieve the NCCL version via PyTorch's API, which is a common way users confirm NCCL's presence and compatibility.
Ensure that your `nvidia-nccl-cu11` package version, your system's CUDA toolkit version, and your deep learning framework's CUDA compilation version are all compatible. Check the documentation for your framework to identify the required NCCL and CUDA versions. You may need to specify an exact version during installation, e.g., `pip install nvidia-nccl-cu11==X.Y.Z` or manage environments carefully with tools like Conda.
If you need direct programmatic access to NCCL from Python, investigate dedicated Python bindings like `NCCL4Py` or `pynccl`, being mindful of their specific CUDA version requirements. Otherwise, leverage NCCL's capabilities through the distributed training modules of deep learning frameworks (e.g., `torch.distributed`).
Consult the NVIDIA NCCL documentation for detailed setup and troubleshooting guides. Ensure `/sys` is properly mounted in containers/VMs, verify GPU-to-GPU communication with `p2pBandwidthLatencyTest` from CUDA samples, and set `NCCL_DEBUG=WARN` to get more explicit error messages from NCCL.
Maintain consistent CUDA versions across all your deep learning ecosystem components. If you require CUDA 12+, use `nvidia-nccl-cu12`. If multiple dependencies inadvertently install different NCCL CUDA versions, environment isolation (e.g., with Conda or virtual environments) is crucial. Prioritize the NCCL version compatible with your primary deep learning framework.
For Windows, ensure you have the correct NVIDIA drivers and CUDA Toolkit installed. Refer to specific guides for installing deep learning frameworks with GPU support on Windows, as they often handle NCCL dependencies. Be prepared for potential manual library path configurations or consider using WSL2 or Docker for a more consistent Linux-like environment.