InternLM 2.5 7B
by Shanghai AI Lab · internlm-2.5 family
7B
parameters
text-generation code-generation reasoning multilingual tool-use math
InternLM 2.5 7B is Shanghai AI Lab's versatile open-source language model featuring strong reasoning, multilingual support, and tool-use capabilities. With a massive 1M token context window, it handles extremely long documents and complex multi-step tasks that most models of its size cannot. The model excels at mathematical reasoning, code generation, and function calling, making it a strong choice for agentic workflows. Its Apache 2.0 license and competitive benchmark scores position it as an excellent option for local deployment on consumer hardware.
Quick Start with Ollama
ollama run 7b-q4_K_M | Creator | Shanghai AI Lab |
| Parameters | 7B |
| Architecture | transformer-decoder |
| Context | 1024K tokens |
| Released | Jul 3, 2024 |
| License | Apache 2.0 |
| Ollama | internlm2:7b |
Quantization Options
| Format | File Size | VRAM Required | Quality | Ollama Tag |
|---|---|---|---|---|
| Q4_K_M rec | 4.4 GB | 5.5 GB | | 7b-q4_K_M |
| Q8_0 | 7.4 GB | 9 GB | | 7b-q8_0 |
| F16 | 14 GB | 16 GB | | 7b-f16 |
Compatible Hardware
Q4_K_M requires 5.5 GB VRAM
Benchmark Scores
72.0
mmlu