Can I Run DeepSeek-R1-Distill-Qwen-32B on NVIDIA L40S?

Name: LLM Configurator — GPU VRAM Checker
Author: LLM Configurator

Superseded model. DeepSeek R1 has been superseded by DeepSeek V4. This page is kept for reference; the newer family is a better starting point. View DeepSeek V4 →

Autor: Jakub Rusinowski · Ostatnia aktualizacja: 21 lipca 2026

These figures are for DeepSeek-R1-Distill-Qwen-32B, a distill of Qwen2.5-32B — not the full DeepSeek R1. The full DeepSeek R1 (671B) needs about 405 GB of weights at Q4_K_M and is a different model.

Yes, comfortably — you'll have ~28.7 GB of headroom running DeepSeek R1 Distill Qwen 32B at Q4_K_M (19.32 GB, ~36 tok/s (est.)) with room for up to 64K context.

Buy This HardwareNVIDIA L40S 48GB — 48 GB VRAM · 350 W board power Deploy in the Cloud NowNVIDIA L40S on RunPod — from $0.86/hr · rate checked 2026-08

or compare on Vast.ai

As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.

Ujawnienie afiliacyjne: Niektóre odnośniki na tej stronie to linki afiliacyjne — jeśli dokonasz zakupu za ich pośrednictwem, LLM Configurator może otrzymać prowizję bez dodatkowych kosztów dla Ciebie. Jako uczestnik programu Amazon Associates, LLM Configurator zarabia na kwalifikujących się zakupach.

NVIDIA L40S 48GB

48 GB VRAM · 350 W board power

Ceny w 2026 są niestabilne — sprawdź aktualną ofertę.

Sprawdź cenę na Amazon

NVIDIA L40S Specs

VRAM	48 GB
Memory Bandwidth	864 GB/s

DeepSeek R1 Distill Qwen 32B on the NVIDIA L40S: VRAM by quantization

Quant	VRAM needed	Fits 48 GB?	Max context
F16	65.9 GB	✗ No	—
Q8_0	35.9 GB	✓ Yes	32K
Q6_K	28.1 GB	✓ Yes	64K
Q5_K_M	24.6 GB	✓ Yes	64K
Q4_K_M	21.2 GB	✓ Yes	64K
Q3_K_M	15.5 GB	✓ Yes	64K
Q2_K	12.4 GB	✓ Yes	128K

VRAM needed assumes a 4K-token context with an f16 KV cache; “Max context” is the largest window that still fits in 48 GB. Figures are estimates from parameter count, quantization and memory bandwidth — the analyzer lets you tune KV-cache quant and context.

DeepSeek R1 Sizes That Fit the NVIDIA L40S

DeepSeek R1 Distill Qwen 32B	Q4_K_M · 19.32 GB · ~36 tok/s (est.)
DeepSeek R1 Distill Qwen 14B	Q4_K_M · 8.4525 GB · ~73 tok/s (est.)
DeepSeek R1 Distill Llama 8B	Q4_K_M · 4.83 GB · ~112 tok/s (est.)

Buy vs. rent DeepSeek-R1-Distill-Qwen-32B

Buy the GPU

~$7,499

NVIDIA L40S · MSRP

Rent by the hour

from $0.34/hr

RTX 4090 (24 GB) class

At 2 hrs/day, buying (~$7,499) beats renting at $0.34/hr after about 30.6 years.

Affiliate links — we may earn a commission if you sign up, at no extra cost to you.

RunPod $0.34/hr

Rent on RunPod →

Vast.ai $0.35/hr · typical low · varies

Rent on Vast.ai →

Cloud rates verified 2026-07 — estimates, and marketplace prices vary. Buying price is GPU MSRP only, not a full PC.

FAQ

DeepSeek R1 on the NVIDIA L40S — does it fit?

Yes, comfortably — you'll have ~28.7 GB of headroom running DeepSeek R1 Distill Qwen 32B at Q4_K_M (19.32 GB, ~36 tok/s (est.)) with room for up to 64K context.

Which DeepSeek R1 variant fits best on the NVIDIA L40S?

DeepSeek R1 Distill Qwen 32B at Q4_K_M quantization (19.32 GB), estimated ~36 tokens/sec, up to 64K context.

Every DeepSeek R1 size on the NVIDIA L40S

Size	VRAM	Verdict	Speed
DeepSeek R1 (671B)	405.1 GB	Does not fit	—
DeepSeek R1 Distill Qwen 14B	8.5 GB	Runs	~73 tok/s
DeepSeek R1 Distill Llama 8B	4.8 GB	Runs	~112 tok/s

DeepSeek R1 on Other GPUs

Popular Models on the NVIDIA L40S

VRAM Tier

Best LLMs for 48 GB VRAM

Troubleshooting

Which GGUF quant should I download? (Q4 vs Q5 vs Q8)

Buying Guide

Best GPU Buyer Guide 2026

← Can I Run It? | DeepSeek R1 Model Page | NVIDIA L40S GPU Page | Check Your Hardware