Skip to content

DeepSeek R1 7B

by DeepSeek · deepseek-r1 family

7B

parameters

text-generation code-generation reasoning math

DeepSeek R1 7B is a distilled reasoning model from DeepSeek's R1 series, based on the Qwen 2.5 architecture. It inherits chain-of-thought reasoning capabilities from the larger DeepSeek R1 model through knowledge distillation, delivering strong reasoning performance at a compact size. This model excels at mathematical problem solving, logical reasoning, and coding tasks. It shows its reasoning process step by step, making it transparent and useful for educational and analytical purposes. It runs efficiently on consumer hardware.

Quick Start with Ollama

ollama run 7b-q8_0
Resources Ollama Hugging Face Official Page Research Paper
Creator DeepSeek
Parameters 7B
Architecture transformer-decoder
Context 128K tokens
Released Jan 20, 2025
License MIT
Ollama deepseek-r1:7b

Quantization Options

Format File Size VRAM Required Quality Ollama Tag
Q4_K_M 3.5 GB 5.7 GB 7b-q4_K_M
Q8_0 rec 6.3 GB 9 GB 7b-q8_0
F16 13.3 GB 16 GB 7b-fp16

Compatible Hardware

Q8_0 requires 9 GB VRAM

Compatible Hardware

HardwareVRAMTypeFitEst. Speed
Mac Studio M4 Ultra 512GB512 GBmacRuns~91 tok/s
Mac Pro M2 Ultra 192GB192 GBmacRuns~89 tok/s
Mac Studio M4 Ultra 192GB192 GBmacRuns~91 tok/s
Mac Studio M4 Max 128GB128 GBmacRuns~61 tok/s
MacBook Pro M4 Max 128GB128 GBmacRuns~61 tok/s
MacBook Pro M5 Max 128GB128 GBmacRuns~61 tok/s
NVIDIA RTX PRO 6000 Blackwell96 GBgpuRuns~213 tok/s
MacBook Pro M3 Max 96GB96 GBmacRuns~44 tok/s
Mac mini M4 Pro 64GB64 GBmacRuns~30 tok/s
Mac Studio M4 Max 64GB64 GBmacRuns~61 tok/s
MacBook Pro M4 Max 64GB64 GBmacRuns~61 tok/s
MacBook Pro M5 Max 64GB64 GBmacRuns~61 tok/s
NVIDIA RTX 6000 Ada Generation48 GBgpuRuns~107 tok/s
NVIDIA RTX A600048 GBgpuRuns~85 tok/s
NVIDIA RTX PRO 5000 Blackwell48 GBgpuRuns~107 tok/s
Mac mini M4 Pro 48GB48 GBmacRuns~30 tok/s
MacBook Pro M3 Max 48GB48 GBmacRuns~44 tok/s
MacBook Pro M4 Pro 48GB48 GBmacRuns~30 tok/s
MacBook Pro M4 Max 48GB48 GBmacRuns~61 tok/s
MacBook Pro M5 Max 48GB48 GBmacRuns~46 tok/s
MacBook Pro M5 Pro 48GB48 GBmacRuns~30 tok/s
Mac Studio M4 Max 36GB36 GBmacRuns~61 tok/s
MacBook Pro M3 Pro 36GB36 GBmacRuns~17 tok/s
MacBook Pro M5 Max 36GB36 GBmacRuns~46 tok/s
NVIDIA RTX 5000 Ada Generation32 GBgpuRuns~80 tok/s
NVIDIA GeForce RTX 509032 GBgpuRuns~199 tok/s
iMac M4 32GB32 GBmacRuns~13 tok/s
Mac mini M4 32GB32 GBmacRuns~13 tok/s
MacBook Air M4 32GB32 GBmacRuns~13 tok/s
MacBook Air M5 32GB32 GBmacRuns~13 tok/s
MacBook Pro M5 32GB32 GBmacRuns~13 tok/s
AMD Radeon RX 7900 XTX24 GBgpuRuns~107 tok/s
NVIDIA GeForce RTX 3090 Ti24 GBgpuRuns~112 tok/s
NVIDIA GeForce RTX 309024 GBgpuRuns~104 tok/s
NVIDIA GeForce RTX 409024 GBgpuRuns~112 tok/s
NVIDIA RTX A500024 GBgpuRuns~85 tok/s
iMac M3 24GB24 GBmacRuns~11 tok/s
Mac mini M2 24GB24 GBmacRuns~11 tok/s
Mac mini M4 Pro 24GB24 GBmacRuns~30 tok/s
MacBook Air M2 24GB24 GBmacRuns~11 tok/s
MacBook Air M4 24GB24 GBmacRuns~13 tok/s
MacBook Air M5 24GB24 GBmacRuns~13 tok/s
MacBook Pro M4 Pro 24GB24 GBmacRuns~30 tok/s
MacBook Pro M5 24GB24 GBmacRuns~13 tok/s
MacBook Pro M5 Pro 24GB24 GBmacRuns~30 tok/s
AMD Radeon RX 7900 XT20 GBgpuRuns~89 tok/s
NVIDIA RTX 4000 Ada Generation20 GBgpuRuns~40 tok/s
MacBook Pro M3 Pro 18GB18 GBmacRuns~17 tok/s
AMD Radeon RX 6800 XT16 GBgpuRuns~57 tok/s
AMD Radeon RX 6900 XT16 GBgpuRuns~57 tok/s
AMD Radeon RX 7800 XT16 GBgpuRuns~69 tok/s
AMD Radeon RX 9060 XT 16GB16 GBgpuRuns~60 tok/s
AMD Radeon RX 9070 XT16 GBgpuRuns~72 tok/s
AMD Radeon RX 907016 GBgpuRuns~60 tok/s
Intel Arc A77016 GBgpuRuns~62 tok/s
NVIDIA GeForce RTX 4060 Ti 16GB16 GBgpuRuns~32 tok/s
NVIDIA GeForce RTX 4070 Ti Super16 GBgpuRuns~75 tok/s
NVIDIA GeForce RTX 4080 Super16 GBgpuRuns~82 tok/s
NVIDIA GeForce RTX 408016 GBgpuRuns~80 tok/s
NVIDIA GeForce RTX 5060 Ti 16GB16 GBgpuRuns~50 tok/s
NVIDIA GeForce RTX 5070 Ti16 GBgpuRuns~100 tok/s
NVIDIA GeForce RTX 508016 GBgpuRuns~107 tok/s
NVIDIA RTX A400016 GBgpuRuns~50 tok/s
iMac M1 16GB16 GBmacRuns~8 tok/s
iMac M4 16GB16 GBmacRuns~13 tok/s
Mac mini M1 16GB16 GBmacRuns~8 tok/s
Mac mini M4 16GB16 GBmacRuns~13 tok/s
MacBook Air M2 16GB16 GBmacRuns~11 tok/s
MacBook Air M3 16GB16 GBmacRuns~11 tok/s
MacBook Air M4 16GB16 GBmacRuns~13 tok/s
MacBook Air M5 16GB16 GBmacRuns~13 tok/s
MacBook Pro M1 16GB16 GBmacRuns~8 tok/s
MacBook Pro M2 Pro 16GB16 GBmacRuns~22 tok/s
MacBook Pro M5 16GB16 GBmacRuns~13 tok/s
AMD Radeon RX 6700 XT12 GBgpuRuns~43 tok/s
AMD Radeon RX 7700 XT12 GBgpuRuns~48 tok/s
Intel Arc B58012 GBgpuRuns~51 tok/s
NVIDIA GeForce RTX 3060 12GB12 GBgpuRuns~40 tok/s
NVIDIA GeForce RTX 3080 12GB12 GBgpuRuns~101 tok/s
NVIDIA GeForce RTX 4070 Super12 GBgpuRuns~56 tok/s
NVIDIA GeForce RTX 4070 Ti12 GBgpuRuns~56 tok/s
NVIDIA GeForce RTX 407012 GBgpuRuns~56 tok/s
NVIDIA GeForce RTX 507012 GBgpuRuns~75 tok/s
NVIDIA GeForce GTX 1080 Ti11 GBgpuRuns~54 tok/s
NVIDIA GeForce RTX 2080 Ti11 GBgpuRuns~68 tok/s
Intel Arc B57010 GBgpuRuns (tight)~42 tok/s
NVIDIA GeForce RTX 3080 10GB10 GBgpuRuns (tight)~84 tok/s
AMD Radeon RX 6600 XT8 GBgpuCPU Offload~8 tok/s
AMD Radeon RX 76008 GBgpuCPU Offload~10 tok/s
Intel Arc A7508 GBgpuCPU Offload~17 tok/s
AMD Radeon RX 9060 XT 8GB8 GBgpuCPU Offload~9 tok/s
NVIDIA GeForce GTX 10708 GBgpuCPU Offload~8 tok/s
NVIDIA GeForce RTX 2060 Super8 GBgpuCPU Offload~15 tok/s
NVIDIA GeForce RTX 2070 Super8 GBgpuCPU Offload~15 tok/s
NVIDIA GeForce RTX 2080 Super8 GBgpuCPU Offload~17 tok/s
NVIDIA GeForce RTX 30508 GBgpuCPU Offload~8 tok/s
NVIDIA GeForce RTX 3060 Ti8 GBgpuCPU Offload~15 tok/s
NVIDIA GeForce RTX 30708 GBgpuCPU Offload~15 tok/s
NVIDIA GeForce RTX 40608 GBgpuCPU Offload~9 tok/s
NVIDIA GeForce RTX 4060 Ti 8GB8 GBgpuCPU Offload~10 tok/s
NVIDIA GeForce RTX 50508 GBgpuCPU Offload~8 tok/s
NVIDIA GeForce RTX 5060 Ti 8GB8 GBgpuCPU Offload~15 tok/s
NVIDIA GeForce RTX 50608 GBgpuCPU Offload~11 tok/s
MacBook Air M1 8GB8 GBmacCPU Offload~2 tok/s
MacBook Air M2 8GB8 GBmacCPU Offload~3 tok/s
NVIDIA GeForce GTX 1660 Super6 GBgpuCPU Offload~11 tok/s
NVIDIA GeForce RTX 20606 GBgpuCPU Offload~11 tok/s

Benchmark Scores

68.5
mmlu