Skip to content

Google · 2B · transformer-decoder

2024-06-27 8K context 2B params

Use Cases

chat code multilingual summary

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_M42.7 GBModerate
Q8_0rec84.0 GBGood
F16166.0 GBExcellent

About this model

Gemma 2 2B is Google's compact open model built on the same research and technology behind the Gemini models. Despite its small size, it delivers impressive performance on text generation and coding tasks, benefiting from Google's extensive training data and techniques. This model is ideal for resource-constrained environments, running smoothly on laptops and even mobile devices. It supports multiple languages and provides fast inference, making it a strong choice for lightweight local AI applications.

Benchmarks

51.3
mmlu