Registry / ai-ml / nvidia-cudnn-cu12

nvidia-cudnn-cu12

JSON →
library9.24.0.43pypypi✓ verified 24d ago

The `nvidia-cudnn-cu12` package provides the NVIDIA CUDA Deep Neural Network (cuDNN) runtime libraries, which are GPU-accelerated primitives essential for deep neural network operations such as convolutions, attention, and matrix multiplication. It acts as a critical low-level dependency, enabling deep learning frameworks like TensorFlow and PyTorch to efficiently leverage NVIDIA GPUs. This specific package targets CUDA 12.x environments. The current version is 9.20.0.48, with releases frequently updated to align with new CUDA Toolkit versions and cuDNN backend enhancements.

pip install nvidia-cudnn-cu12
INSTALL
IMPORT
SIG · NVIDIA-CUDNN-CU12
N
nvidia-cudnn-cu12
ai-mlpythonv9.24.0.43
Install
29.1s avg
Import
Disk
2355MB
Pass rate
5/ 10
Env Coverage5 / 10
glibc
3.93.13
musl
3.93.13
Install & Compatibility
Where this runs
tested against v9.24.0.43 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
py 3.103.910 runs
build_error
glibc
py 3.103.910 runs
installs and imports cleanly · install 29.1s · import 0.000s · 2355.2MB
2355MB installed
● package 2355MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

cudnn
from nvidia import cudnn
import cudnn

This quickstart demonstrates how to verify that a deep learning framework like TensorFlow can detect and utilize your GPU, and implicitly, the underlying cuDNN runtime. Successful execution of this code confirms that `nvidia-cudnn-cu12` is likely correctly installed and accessible by TensorFlow. Note that the cuDNN version reported by TensorFlow is the version it was *built with*, not necessarily the exact version dynamically loaded, though they should be compatible.

import tensorflow as tf import os # Ensure TensorFlow doesn't pre-allocate all GPU memory os.environ['TF_FORCE_GPU_ALLOW_GROWTH'] = 'true' # Check if TensorFlow can detect and use GPUs gpus = tf.config.list_physical_devices('GPU') if gpus: print(f"TensorFlow detected the following GPUs: {gpus}") try: # Limit GPU memory growth to avoid allocating all memory at once (alternative to env var) for gpu in gpus: tf.config.experimental.set_memory_growth(gpu, True) print("GPU memory growth set to True.") except RuntimeError as e: # Memory growth must be set before GPUs have been initialized print(f"Error setting memory growth: {e}") print(f"TensorFlow is built with CUDA: {tf.test.is_built_with_cuda()}") # TensorFlow's built-in cuDNN version (indicates what TF was compiled with) print(f"TensorFlow's built-in cuDNN version: {tf.sysconfig.get_build_info().get('CUDNN_VERSION', 'N/A')}") # A small operation to trigger GPU usage if available try: with tf.device('/GPU:0'): a = tf.constant([[1.0, 2.0], [3.0, 4.0]]) b = tf.constant([[1.0, 1.0], [1.0, 1.0]]) c = tf.matmul(a, b) print(f"Simple matrix multiplication on GPU: {c.numpy()}") except RuntimeError as e: print(f"Could not run on GPU: {e}. Running on CPU instead.") a = tf.constant([[1.0, 2.0], [3.0, 4.0]]) b = tf.constant([[1.0, 1.0], [1.0, 1.0]]) c = tf.matmul(a, b) print(f"Simple matrix multiplication on CPU: {c.numpy()}") else: print("TensorFlow did not detect any GPUs. Please ensure CUDA and cuDNN are correctly installed and configured.")
Debug
Known issues
breakingStarting with CUDA 12.5 and later, cuDNN is no longer bundled directly within the CUDA Toolkit installer. This change requires users (especially C++ toolchain developers) to manage cuDNN installation and versioning separately, although `pip install nvidia-cudnn-cu12` simplifies this for Python environments.
fix
Ensure you are installing `nvidia-cudnn-cu12` (or the appropriate CUDA version) via pip, or manually managing separate cuDNN archives if not using Python wheels, and verify compatibility with your CUDA Toolkit version.
affects: CUDA Toolkit 12.5 and higher, cuDNN 9.x series
gotchaDirect Python API calls for `nvidia-cudnn-cu12` are not available. This package provides the low-level runtime binaries. To programmatically interact with cuDNN functionality in Python (e.g., build computation graphs), you must install the `nvidia-cudnn-frontend` package separately and import it as `cudnn`.
fix
If you intend to use cuDNN's API directly in Python, install `nvidia-cudnn-frontend` via `pip install nvidia-cudnn-frontend` and then `import cudnn` in your Python code.
affects: All versions of `nvidia-cudnn-cu12`
gotchaVersion compatibility between `nvidia-cudnn-cu12`, the installed NVIDIA CUDA Toolkit, and your deep learning framework (e.g., TensorFlow, PyTorch) is crucial. Frameworks are often built against specific cuDNN versions. Installing a standalone `nvidia-cudnn-cu12` might not be compatible with the version your framework expects, leading to runtime errors (e.g., 'DLL load failed' or 'cuDNN initialization error').
fix
Always refer to the official documentation of your deep learning framework for recommended or required CUDA and cuDNN versions. When possible, allow the framework's installation (e.g., `pip install tensorflow[and-cuda]`) to manage cuDNN dependencies, or carefully match versions if installing separately.
affects: All versions
gotcha`nvidia-cudnn-cu12` implies compatibility with CUDA Toolkit 12.x. Using it with an older or incompatible CUDA Toolkit version installed on your system can lead to runtime issues or failures in GPU acceleration.
fix
Ensure your installed NVIDIA CUDA Toolkit version is 12.x and that your GPU drivers are up-to-date and compatible with CUDA 12.x.
affects: All versions
breakingThe `nvidia-cudnn-cu12` package is a placeholder that requires downloading the actual wheel from NVIDIA's PyPI index. If `https://pypi.nvidia.com` is not implicitly used or specified, `pip` will fail to find or download the actual package, leading to an 'Didn't find wheel' error during metadata preparation.
fix
Install the package by explicitly adding NVIDIA's PyPI as an extra index URL: `pip install --extra-index-url https://pypi.nvidia.com nvidia-cudnn-cu12`.
affects: All versions of `nvidia-cudnn-cu12`
Upgrade
Version history
9.24.0.43latest on PyPI · released Jul 2, 2026
Audit
Dependencies
nvidia-cublas-cu12requiredRequired CUDA BLAS library for GPU computations.
Agent activity
31 hits · last 30 days
node
28
Amazon
1
OpenAI (training)
1
Resources
nvidia-cudnn-cu12 — pip install nvidia-cudnn-cu12 · libregistry