Skip to content

Meta · 70B · transformer-decoder

2024-07-23131K context70B params

Use Cases

chatcodereasoningmultilingualtoolsmathwritingsummary

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_Mrec443.5 GBGood
Q5_K_M550.5 GBGood
Q8_0872.0 GBExcellent

About this model

Llama 3.1 70B is Meta's large-scale open model delivering near-frontier performance across a wide range of tasks. It excels at complex reasoning, coding, mathematical problem solving, and creative writing. With 70 billion parameters, this model requires significant hardware but rewards users with exceptional quality. It supports 128K context, native tool use, and multilingual capabilities across eight languages.

Benchmarks

83.6
mmlu