OpenChat 3.5 7B
by OpenChat · openchat family
7B
parameters
text-generation code-generation reasoning multilingual
OpenChat 3.5 7B is an open-source language model that achieves remarkable performance through a novel training approach called Conditioned Reinforcement Learning Fine-Tuning (C-RLFT). It delivers competitive results against models many times its size on reasoning and general knowledge benchmarks. Built on the Mistral 7B architecture, OpenChat 3.5 provides strong multilingual capabilities and instruction following quality, making it one of the most capable 7B-class models for local deployment on consumer hardware.
Quick Start with Ollama
ollama run 7b-q4_K_M Resources
Ollama
| Creator | OpenChat |
| Parameters | 7B |
| Architecture | transformer-decoder |
| Context | 8K tokens |
| Released | Nov 1, 2023 |
| License | Apache 2.0 |
| Ollama | openchat:7b |
Quantization Options
| Format | File Size | VRAM Required | Quality | Ollama Tag |
|---|---|---|---|---|
| Q4_K_M rec | 4.4 GB | 6.9 GB | | 7b-q4_K_M |
| Q8_0 | 7.4 GB | 9.9 GB | | 7b-q8_0 |
| F16 | 14 GB | 17 GB | | 7b-fp16 |
Compatible Hardware
Q4_K_M requires 6.9 GB VRAM
Benchmark Scores
66.0
mmlu