Skip to content

StarCoder2 3B

by BigCode · starcoder family

3B

parameters

code-generation text-generation

StarCoder2 3B is the smallest model in the BigCode StarCoder2 family, trained on The Stack v2 dataset covering over 600 programming languages. Despite its compact size, it delivers surprisingly capable code generation and completion, making it ideal for resource-constrained environments. The model supports 16K context and fill-in-the-middle capabilities for IDE-style code completion. Its small footprint means it can run on virtually any modern GPU, providing fast inference for everyday coding tasks without requiring significant hardware investment.

Quick Start with Ollama

ollama run 3b-q4_K_M
Resources Ollama Hugging Face Official Page Research Paper
Creator BigCode
Parameters 3B
Architecture transformer-decoder
Context 16K tokens
Released Feb 28, 2024
License BigCode Open RAIL-M v1
Ollama starcoder2:3b

Quantization Options

Format File Size VRAM Required Quality Ollama Tag
Q4_K_M rec 1.8 GB 3.5 GB 3b-q4_K_M
Q8_0 3.2 GB 5 GB 3b-q8_0
F16 6 GB 8 GB 3b-f16

Compatible Hardware

Q4_K_M requires 3.5 GB VRAM

Compatible Hardware

HardwareVRAMTypeFitEst. Speed
Mac Studio M4 Ultra 512GB512 GBmacRuns~234 tok/s
Mac Pro M2 Ultra 192GB192 GBmacRuns~229 tok/s
Mac Studio M4 Ultra 192GB192 GBmacRuns~234 tok/s
Mac Studio M4 Max 128GB128 GBmacRuns~156 tok/s
MacBook Pro M4 Max 128GB128 GBmacRuns~156 tok/s
MacBook Pro M5 Max 128GB128 GBmacRuns~156 tok/s
NVIDIA RTX PRO 6000 Blackwell96 GBgpuRuns~549 tok/s
MacBook Pro M3 Max 96GB96 GBmacRuns~114 tok/s
Mac mini M4 Pro 64GB64 GBmacRuns~78 tok/s
Mac Studio M4 Max 64GB64 GBmacRuns~156 tok/s
MacBook Pro M4 Max 64GB64 GBmacRuns~156 tok/s
MacBook Pro M5 Max 64GB64 GBmacRuns~156 tok/s
NVIDIA RTX 6000 Ada Generation48 GBgpuRuns~274 tok/s
NVIDIA RTX A600048 GBgpuRuns~219 tok/s
NVIDIA RTX PRO 5000 Blackwell48 GBgpuRuns~274 tok/s
Mac mini M4 Pro 48GB48 GBmacRuns~78 tok/s
MacBook Pro M3 Max 48GB48 GBmacRuns~114 tok/s
MacBook Pro M4 Max 48GB48 GBmacRuns~156 tok/s
MacBook Pro M4 Pro 48GB48 GBmacRuns~78 tok/s
MacBook Pro M5 Max 48GB48 GBmacRuns~117 tok/s
MacBook Pro M5 Pro 48GB48 GBmacRuns~78 tok/s
Mac Studio M4 Max 36GB36 GBmacRuns~156 tok/s
MacBook Pro M3 Pro 36GB36 GBmacRuns~43 tok/s
MacBook Pro M5 Max 36GB36 GBmacRuns~117 tok/s
NVIDIA RTX 5000 Ada Generation32 GBgpuRuns~206 tok/s
NVIDIA GeForce RTX 509032 GBgpuRuns~512 tok/s
iMac M4 32GB32 GBmacRuns~34 tok/s
Mac mini M4 32GB32 GBmacRuns~34 tok/s
MacBook Air M5 32GB32 GBmacRuns~34 tok/s
MacBook Air M4 32GB32 GBmacRuns~34 tok/s
MacBook Pro M5 32GB32 GBmacRuns~34 tok/s
AMD Radeon RX 7900 XTX24 GBgpuRuns~274 tok/s
NVIDIA GeForce RTX 3090 Ti24 GBgpuRuns~288 tok/s
NVIDIA GeForce RTX 309024 GBgpuRuns~267 tok/s
NVIDIA GeForce RTX 409024 GBgpuRuns~288 tok/s
NVIDIA RTX A500024 GBgpuRuns~219 tok/s
iMac M3 24GB24 GBmacRuns~29 tok/s
Mac mini M2 24GB24 GBmacRuns~29 tok/s
Mac mini M4 Pro 24GB24 GBmacRuns~78 tok/s
MacBook Air M2 24GB24 GBmacRuns~29 tok/s
MacBook Air M4 24GB24 GBmacRuns~34 tok/s
MacBook Air M5 24GB24 GBmacRuns~34 tok/s
MacBook Pro M4 Pro 24GB24 GBmacRuns~78 tok/s
MacBook Pro M5 24GB24 GBmacRuns~34 tok/s
MacBook Pro M5 Pro 24GB24 GBmacRuns~78 tok/s
AMD Radeon RX 7900 XT20 GBgpuRuns~229 tok/s
NVIDIA RTX 4000 Ada Generation20 GBgpuRuns~103 tok/s
MacBook Pro M3 Pro 18GB18 GBmacRuns~43 tok/s
AMD Radeon RX 6800 XT16 GBgpuRuns~146 tok/s
AMD Radeon RX 6900 XT16 GBgpuRuns~146 tok/s
AMD Radeon RX 7800 XT16 GBgpuRuns~178 tok/s
AMD Radeon RX 9060 XT 16GB16 GBgpuRuns~154 tok/s
AMD Radeon RX 9070 XT16 GBgpuRuns~186 tok/s
AMD Radeon RX 907016 GBgpuRuns~154 tok/s
Intel Arc A77016 GBgpuRuns~160 tok/s
NVIDIA GeForce RTX 4060 Ti 16GB16 GBgpuRuns~82 tok/s
NVIDIA GeForce RTX 4070 Ti Super16 GBgpuRuns~192 tok/s
NVIDIA GeForce RTX 4080 Super16 GBgpuRuns~210 tok/s
NVIDIA GeForce RTX 408016 GBgpuRuns~205 tok/s
NVIDIA GeForce RTX 5060 Ti 16GB16 GBgpuRuns~128 tok/s
NVIDIA GeForce RTX 5070 Ti16 GBgpuRuns~256 tok/s
NVIDIA GeForce RTX 508016 GBgpuRuns~274 tok/s
NVIDIA RTX A400016 GBgpuRuns~128 tok/s
iMac M1 16GB16 GBmacRuns~19 tok/s
iMac M4 16GB16 GBmacRuns~34 tok/s
Mac mini M1 16GB16 GBmacRuns~19 tok/s
Mac mini M4 16GB16 GBmacRuns~34 tok/s
MacBook Air M2 16GB16 GBmacRuns~29 tok/s
MacBook Air M4 16GB16 GBmacRuns~34 tok/s
MacBook Air M3 16GB16 GBmacRuns~29 tok/s
MacBook Air M5 16GB16 GBmacRuns~34 tok/s
MacBook Pro M2 Pro 16GB16 GBmacRuns~57 tok/s
MacBook Pro M1 16GB16 GBmacRuns~19 tok/s
MacBook Pro M5 16GB16 GBmacRuns~34 tok/s
AMD Radeon RX 6700 XT12 GBgpuRuns~110 tok/s
AMD Radeon RX 7700 XT12 GBgpuRuns~123 tok/s
Intel Arc B58012 GBgpuRuns~130 tok/s
NVIDIA GeForce RTX 3060 12GB12 GBgpuRuns~103 tok/s
NVIDIA GeForce RTX 3080 12GB12 GBgpuRuns~261 tok/s
NVIDIA GeForce RTX 4070 Super12 GBgpuRuns~144 tok/s
NVIDIA GeForce RTX 4070 Ti12 GBgpuRuns~144 tok/s
NVIDIA GeForce RTX 407012 GBgpuRuns~144 tok/s
NVIDIA GeForce RTX 507012 GBgpuRuns~192 tok/s
NVIDIA GeForce GTX 1080 Ti11 GBgpuRuns~138 tok/s
NVIDIA GeForce RTX 2080 Ti11 GBgpuRuns~176 tok/s
Intel Arc B57010 GBgpuRuns~109 tok/s
NVIDIA GeForce RTX 3080 10GB10 GBgpuRuns~217 tok/s
AMD Radeon RX 6600 XT8 GBgpuRuns~73 tok/s
AMD Radeon RX 76008 GBgpuRuns~82 tok/s
AMD Radeon RX 9060 XT 8GB8 GBgpuRuns~77 tok/s
Intel Arc A7508 GBgpuRuns~146 tok/s
NVIDIA GeForce GTX 10708 GBgpuRuns~73 tok/s
NVIDIA GeForce RTX 2060 Super8 GBgpuRuns~128 tok/s
NVIDIA GeForce RTX 2070 Super8 GBgpuRuns~128 tok/s
NVIDIA GeForce RTX 2080 Super8 GBgpuRuns~142 tok/s
NVIDIA GeForce RTX 30508 GBgpuRuns~64 tok/s
NVIDIA GeForce RTX 3060 Ti8 GBgpuRuns~128 tok/s
NVIDIA GeForce RTX 30708 GBgpuRuns~128 tok/s
NVIDIA GeForce RTX 4060 Ti 8GB8 GBgpuRuns~82 tok/s
NVIDIA GeForce RTX 40608 GBgpuRuns~78 tok/s
NVIDIA GeForce RTX 50508 GBgpuRuns~64 tok/s
NVIDIA GeForce RTX 5060 Ti 8GB8 GBgpuRuns~128 tok/s
NVIDIA GeForce RTX 50608 GBgpuRuns~96 tok/s
MacBook Air M1 8GB8 GBmacRuns~19 tok/s
MacBook Air M2 8GB8 GBmacRuns~29 tok/s
NVIDIA GeForce GTX 1660 Super6 GBgpuRuns~96 tok/s
NVIDIA GeForce RTX 20606 GBgpuRuns~96 tok/s

Benchmark Scores

35.0
mmlu