Skip to content

TII · 7B · transformer-decoder

2024-12-11 33K context 7B params

Use Cases

chat code reasoning multilingual

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec46.8 GBGood
Q8_0810.0 GBGood
F161617.5 GBExcellent

About this model

Falcon 3 7B is the compact variant of TII's third-generation Falcon language model family. It delivers solid general-purpose performance across text generation, coding, reasoning, and multilingual tasks in an efficient 7B parameter package. Built by the Technology Innovation Institute in Abu Dhabi, Falcon 3 7B offers competitive quality at its size class while being lightweight enough to run on consumer GPUs with 8GB or more of VRAM.

Benchmarks

68.0
mmlu