Falcon 3 7B
by TII · falcon family
7B
parameters
text-generation code-generation reasoning multilingual
Falcon 3 7B is the compact variant of TII's third-generation Falcon language model family. It delivers solid general-purpose performance across text generation, coding, reasoning, and multilingual tasks in an efficient 7B parameter package. Built by the Technology Innovation Institute in Abu Dhabi, Falcon 3 7B offers competitive quality at its size class while being lightweight enough to run on consumer GPUs with 8GB or more of VRAM.
Quick Start with Ollama
ollama run 7b-q4_K_M | Creator | TII |
| Parameters | 7B |
| Architecture | transformer-decoder |
| Context | 32K tokens |
| Released | Dec 11, 2024 |
| License | TII Falcon License 2.0 |
| Ollama | falcon3:7b |
Quantization Options
| Format | File Size | VRAM Required | Quality | Ollama Tag |
|---|---|---|---|---|
| Q4_K_M rec | 4.4 GB | 6.8 GB | | 7b-q4_K_M |
| Q8_0 | 7.5 GB | 10 GB | | 7b-q8_0 |
| F16 | 14 GB | 17.5 GB | | 7b-fp16 |
Compatible Hardware
Q4_K_M requires 6.8 GB VRAM
Benchmark Scores
68.0
mmlu