Skip to content

Google · 9B · transformer-decoder

2024-06-27 8K context 9B params

Use Cases

chat code reasoning multilingual summary

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_M46.9 GBModerate
Q8_0rec811.0 GBGood
F161620.0 GBExcellent

About this model

Gemma 2 9B is Google's mid-range open model that punches well above its weight, outperforming many larger models on key benchmarks. It incorporates knowledge distillation from larger Gemma models, resulting in exceptional quality for its parameter count. The model excels at reasoning, text generation, and multilingual tasks. With its 8K context window and moderate resource requirements, it is an excellent choice for users seeking strong general-purpose performance on consumer-grade hardware.

Benchmarks

71.3
mmlu