Skip to content

Google · 27B · transformer-decoder

2024-06-27 8K context 27B params

Use Cases

chat code reasoning multilingual math writing summary

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec417.7 GBGood
Q5_K_M520.4 GBGood
Q8_0829.0 GBExcellent

About this model

Gemma 2 27B is the largest model in Google's Gemma 2 family, delivering top-tier performance among open models in the 20-30B parameter range. It benefits from advanced training techniques including knowledge distillation and RLHF, resulting in highly capable and well-aligned outputs. This model offers excellent performance on reasoning, coding, and creative tasks. While it requires a capable GPU, it fits comfortably on high-end consumer cards at Q4 quantization, making it accessible to enthusiasts with 24GB VRAM GPUs.

Benchmarks

75.2
mmlu