Skip to content

Meta · 70B · transformer-decoder

2024-12-06131K context70B params

Use Cases

chatcodereasoningmultilingualtoolsmathwritingsummary

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec443.5 GBGood
Q5_K_M550.5 GBGood
Q8_0872.0 GBExcellent

About this model

Llama 3.3 70B is Meta's most capable model in the Llama 3 series at the 70B parameter scale. It delivers performance competitive with much larger models like Llama 3.1 405B on many benchmarks, particularly in reasoning, coding, and multilingual tasks. This model represents a significant efficiency improvement, offering near-frontier performance in a size that can run on high-end consumer hardware with appropriate quantization. It supports 128K context and excels at instruction following, tool use, and complex reasoning.

Benchmarks

86.0
mmlu