Won't start or won't see your GPUWindowsLinuxLast updated June 22, 2026

"No CUDA-capable device is detected" — how to fix it

My GPU is right there and CUDA says there is no device

Written by Jakub Rusinowski

The error

RuntimeError: No CUDA-capable device is detected

When you see it

Your code or runtime can't find the GPU at all — torch.cuda.is_available() returns False, and anything that needs CUDA bails immediately. The card is physically there, but the software stack can't see it.

What's actually going on

Unlike an out-of-memory error, this one is about visibility, not capacity. Something in the chain — NVIDIA driver, CUDA runtime, the framework's CUDA build, or an environment variable — is broken or mismatched, so the GPU never gets exposed to your process. Common causes: a missing/outdated driver, a CPU-only PyTorch install, a CUDA_VISIBLE_DEVICES set to empty, or running inside a container without GPU passthrough.

How to fix it

  1. 1

    Confirm the driver sees the GPU

    Start at the bottom of the stack. nvidia-smi talks directly to the driver — if it lists your card, the driver is fine and the problem is higher up (framework/toolkit). If nvidia-smi itself fails or shows nothing, install or update the NVIDIA driver first; nothing above it can work until this does.

    bash
    nvidia-smi
  2. 2

    Install a CUDA-enabled build of your framework

    A plain pip install torch can pull a CPU-only wheel that will never see the GPU. Reinstall the CUDA build that matches your driver. After installing, verify from Python that CUDA is now available.

    bash
    # example: CUDA 12.1 build of PyTorch
pip install torch --index-url https://download.pytorch.org/whl/cu121

python -c "import torch; print(torch.cuda.is_available())"
  3. 3

    Check CUDA_VISIBLE_DEVICES

    If this variable is set to an empty string or a non-existent index, CUDA hides every GPU. Unset it (or set it to a valid index) and retry.

    bash
    echo $CUDA_VISIBLE_DEVICES   # if empty-string or wrong, fix it:
unset CUDA_VISIBLE_DEVICES
  4. 4

    In Docker, pass the GPU through

    Containers don't get the GPU by default. You need the NVIDIA Container Toolkit installed on the host and the --gpus all flag on docker run, otherwise the container sees no CUDA device.

    bash
    docker run --gpus all <image>
  5. 5

    Once CUDA works, make sure your model actually fitsMost common fix

    When the GPU is finally visible, the next wall people hit is memory — the model being too big for the card. That part is worth getting right up front: check which model and quant fit your VRAM so you don't trade a visibility error for an out-of-memory one.

    Check what fits your hardwareonce your GPU is detected, see which models fit its VRAMOpen the VRAM checker →
Also affects: Linux

Related

Frequently asked questions

Is "No CUDA-capable device is detected" a hardware fault?

Rarely. It is almost always a software/visibility issue — missing or mismatched driver, a CPU-only framework build, or an environment/container setting. Start with nvidia-smi: if that sees the card, the hardware is fine.

nvidia-smi works but PyTorch still says no device — why?

That points to a CPU-only or wrong-CUDA-version PyTorch install. Reinstall the CUDA build matching your driver, then check torch.cuda.is_available() again.

Do I need the full CUDA Toolkit installed?

For most prebuilt frameworks (PyTorch, Ollama, llama.cpp releases) you only need a recent NVIDIA driver — the CUDA runtime ships with the package. You need the full toolkit mainly when compiling CUDA code yourself.