Skip to content

Mistral Large 2 123B

by Mistral AI · mistral family

123B

parameters

text-generation code-generation reasoning multilingual math tool-use creative-writing summarization

Mistral Large 2 is Mistral AI's flagship 123 billion parameter model, delivering significant improvements in code generation, mathematics, reasoning, and multilingual support across dozens of languages. It features a massive 128K context window and strong instruction-following capabilities. The model excels at complex reasoning tasks, tool use, and function calling, making it well-suited for agentic workflows. It competes with the largest frontier models while being available under an open research license.

Quick Start with Ollama

ollama run q4_K_M
Resources Ollama Hugging Face Official Page
Creator Mistral AI
Parameters 123B
Architecture transformer-decoder
Context 128K tokens
Released Jul 24, 2024
License Mistral Research License
Ollama mistral-large

Quantization Options

Format File Size VRAM Required Quality Ollama Tag
Q4_K_M rec 62 GB 67 GB q4_K_M
Q8_0 123 GB 129 GB q8_0

Compatible Hardware

Q4_K_M requires 67 GB VRAM

Compatible Hardware

HardwareVRAMTypeFitEst. Speed
Mac Studio M4 Ultra 512GB512 GBmacRuns~12 tok/s
Mac Pro M2 Ultra 192GB192 GBmacRuns~12 tok/s
Mac Studio M4 Ultra 192GB192 GBmacRuns~12 tok/s
Mac Studio M4 Max 128GB128 GBmacRuns~8 tok/s
MacBook Pro M4 Max 128GB128 GBmacRuns~8 tok/s
MacBook Pro M5 Max 128GB128 GBmacRuns~8 tok/s
NVIDIA RTX PRO 6000 Blackwell96 GBgpuRuns~29 tok/s
MacBook Pro M3 Max 96GB96 GBmacRuns~6 tok/s
Mac mini M4 Pro 64GB64 GBmacCPU Offload~1 tok/s
Mac Studio M4 Max 64GB64 GBmacCPU Offload~2 tok/s
MacBook Pro M4 Max 64GB64 GBmacCPU Offload~2 tok/s
MacBook Pro M5 Max 64GB64 GBmacCPU Offload~2 tok/s
NVIDIA RTX 6000 Ada Generation48 GBgpuCPU Offload~4 tok/s
NVIDIA RTX A600048 GBgpuCPU Offload~3 tok/s
NVIDIA RTX PRO 5000 Blackwell48 GBgpuCPU Offload~4 tok/s
Mac mini M4 Pro 48GB48 GBmacCPU Offload~1 tok/s
MacBook Pro M3 Max 48GB48 GBmacCPU Offload~2 tok/s
MacBook Pro M4 Pro 48GB48 GBmacCPU Offload~1 tok/s
MacBook Pro M4 Max 48GB48 GBmacCPU Offload~2 tok/s
MacBook Pro M5 Max 48GB48 GBmacCPU Offload~2 tok/s
MacBook Pro M5 Pro 48GB48 GBmacCPU Offload~1 tok/s
86 hardware device(s) cannot run this model at Q4_K_M.

Benchmark Scores

84.0
mmlu