Skip to content

DeepSeek R1 32B

by DeepSeek · deepseek-r1 family

32B

parameters

text-generation code-generation reasoning math creative-writing

DeepSeek R1 32B is a distilled reasoning model based on the Qwen 2.5 32B architecture, offering strong chain-of-thought reasoning capabilities in a size that fits on high-end consumer hardware. It provides a significant quality uplift over the 14B variant for complex reasoning tasks. This model excels at multi-step mathematical proofs, algorithmic problem solving, and analytical writing. At Q4 quantization it fits on a single 24GB GPU, making it the sweet spot for users who want powerful reasoning without requiring multi-GPU setups.

Quick Start with Ollama

ollama run 32b-q4_K_M
Resources Ollama Hugging Face Official Page Research Paper
Creator DeepSeek
Parameters 32B
Architecture transformer-decoder
Context 128K tokens
Released Jan 20, 2025
License MIT
Ollama deepseek-r1:32b

Quantization Options

Format File Size VRAM Required Quality Ollama Tag
Q4_K_M rec 16 GB 20.7 GB 32b-q4_K_M
Q5_K_M 18.7 GB 23.9 GB 32b-q5_K_M
Q8_0 28.8 GB 34 GB 32b-q8_0

Compatible Hardware

Q4_K_M requires 20.7 GB VRAM

Compatible Hardware

HardwareVRAMTypeFitEst. Speed
Mac Studio M4 Ultra 512GB512 GBmacRuns~40 tok/s
Mac Pro M2 Ultra 192GB192 GBmacRuns~39 tok/s
Mac Studio M4 Ultra 192GB192 GBmacRuns~40 tok/s
Mac Studio M4 Max 128GB128 GBmacRuns~26 tok/s
MacBook Pro M4 Max 128GB128 GBmacRuns~26 tok/s
MacBook Pro M5 Max 128GB128 GBmacRuns~26 tok/s
NVIDIA RTX PRO 6000 Blackwell96 GBgpuRuns~93 tok/s
MacBook Pro M3 Max 96GB96 GBmacRuns~19 tok/s
Mac mini M4 Pro 64GB64 GBmacRuns~13 tok/s
Mac Studio M4 Max 64GB64 GBmacRuns~26 tok/s
MacBook Pro M4 Max 64GB64 GBmacRuns~26 tok/s
MacBook Pro M5 Max 64GB64 GBmacRuns~26 tok/s
NVIDIA RTX 6000 Ada Generation48 GBgpuRuns~46 tok/s
NVIDIA RTX A600048 GBgpuRuns~37 tok/s
NVIDIA RTX PRO 5000 Blackwell48 GBgpuRuns~46 tok/s
Mac mini M4 Pro 48GB48 GBmacRuns~13 tok/s
MacBook Pro M3 Max 48GB48 GBmacRuns~19 tok/s
MacBook Pro M4 Pro 48GB48 GBmacRuns~13 tok/s
MacBook Pro M4 Max 48GB48 GBmacRuns~26 tok/s
MacBook Pro M5 Max 48GB48 GBmacRuns~20 tok/s
MacBook Pro M5 Pro 48GB48 GBmacRuns~13 tok/s
Mac Studio M4 Max 36GB36 GBmacRuns~26 tok/s
MacBook Pro M3 Pro 36GB36 GBmacRuns~7 tok/s
MacBook Pro M5 Max 36GB36 GBmacRuns~20 tok/s
NVIDIA RTX 5000 Ada Generation32 GBgpuRuns~35 tok/s
NVIDIA GeForce RTX 509032 GBgpuRuns~87 tok/s
iMac M4 32GB32 GBmacRuns~6 tok/s
Mac mini M4 32GB32 GBmacRuns~6 tok/s
MacBook Air M4 32GB32 GBmacRuns~6 tok/s
MacBook Air M5 32GB32 GBmacRuns~6 tok/s
MacBook Pro M5 32GB32 GBmacRuns~6 tok/s
AMD Radeon RX 7900 XTX24 GBgpuRuns (tight)~46 tok/s
NVIDIA GeForce RTX 3090 Ti24 GBgpuRuns (tight)~49 tok/s
NVIDIA GeForce RTX 309024 GBgpuRuns (tight)~45 tok/s
NVIDIA GeForce RTX 409024 GBgpuRuns (tight)~49 tok/s
NVIDIA RTX A500024 GBgpuRuns (tight)~37 tok/s
iMac M3 24GB24 GBmacRuns (tight)~5 tok/s
Mac mini M2 24GB24 GBmacRuns (tight)~5 tok/s
Mac mini M4 Pro 24GB24 GBmacRuns (tight)~13 tok/s
MacBook Air M2 24GB24 GBmacRuns (tight)~5 tok/s
MacBook Air M4 24GB24 GBmacRuns (tight)~6 tok/s
MacBook Air M5 24GB24 GBmacRuns (tight)~6 tok/s
MacBook Pro M4 Pro 24GB24 GBmacRuns (tight)~13 tok/s
MacBook Pro M5 24GB24 GBmacRuns (tight)~6 tok/s
MacBook Pro M5 Pro 24GB24 GBmacRuns (tight)~13 tok/s
AMD Radeon RX 7900 XT20 GBgpuCPU Offload~12 tok/s
NVIDIA RTX 4000 Ada Generation20 GBgpuCPU Offload~5 tok/s
MacBook Pro M3 Pro 18GB18 GBmacCPU Offload~2 tok/s
AMD Radeon RX 6800 XT16 GBgpuCPU Offload~8 tok/s
AMD Radeon RX 6900 XT16 GBgpuCPU Offload~8 tok/s
AMD Radeon RX 7800 XT16 GBgpuCPU Offload~9 tok/s
AMD Radeon RX 9060 XT 16GB16 GBgpuCPU Offload~8 tok/s
AMD Radeon RX 9070 XT16 GBgpuCPU Offload~9 tok/s
AMD Radeon RX 907016 GBgpuCPU Offload~8 tok/s
Intel Arc A77016 GBgpuCPU Offload~8 tok/s
NVIDIA GeForce RTX 4060 Ti 16GB16 GBgpuCPU Offload~4 tok/s
NVIDIA GeForce RTX 4070 Ti Super16 GBgpuCPU Offload~10 tok/s
NVIDIA GeForce RTX 4080 Super16 GBgpuCPU Offload~11 tok/s
NVIDIA GeForce RTX 408016 GBgpuCPU Offload~11 tok/s
NVIDIA GeForce RTX 5060 Ti 16GB16 GBgpuCPU Offload~7 tok/s
NVIDIA GeForce RTX 5070 Ti16 GBgpuCPU Offload~13 tok/s
NVIDIA GeForce RTX 508016 GBgpuCPU Offload~14 tok/s
NVIDIA RTX A400016 GBgpuCPU Offload~7 tok/s
iMac M1 16GB16 GBmacCPU Offload~1 tok/s
iMac M4 16GB16 GBmacCPU Offload~2 tok/s
Mac mini M1 16GB16 GBmacCPU Offload~1 tok/s
Mac mini M4 16GB16 GBmacCPU Offload~2 tok/s
MacBook Air M2 16GB16 GBmacCPU Offload~2 tok/s
MacBook Air M3 16GB16 GBmacCPU Offload~2 tok/s
MacBook Air M4 16GB16 GBmacCPU Offload~2 tok/s
MacBook Air M5 16GB16 GBmacCPU Offload~2 tok/s
MacBook Pro M1 16GB16 GBmacCPU Offload~1 tok/s
MacBook Pro M2 Pro 16GB16 GBmacCPU Offload~3 tok/s
MacBook Pro M5 16GB16 GBmacCPU Offload~2 tok/s
33 hardware device(s) cannot run this model at Q4_K_M.

Benchmark Scores

83.2
mmlu