Skip to content

Meta · 405B · transformer-decoder

2024-07-23131K context405B params

Use Cases

chatcodereasoningmultilingualtoolsmathwritingsummary

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec4244.5 GBGood
Q5_K_M5285.0 GBExcellent

About this model

Llama 3.1 405B is the largest and most capable model in the Llama family, representing Meta's flagship open-source release. It competes directly with leading proprietary models on benchmarks spanning reasoning, coding, math, and multilingual understanding. Running this model locally requires enterprise-grade hardware with multiple high-end GPUs. However, for users with the necessary infrastructure, it provides state-of-the-art open-source performance without any API dependencies.

Benchmarks

87.3
mmlu