Skip to content

Phi-3 Mini 3.8B

MIT

Microsoft · 3.8B · transformer-decoder

2024-04-23128K context3.8B params

Use Cases

chatcodereasoningmathsummary

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_M43.8 GBModerate
Q8_0rec85.8 GBGood
F16169.6 GBExcellent

About this model

Phi-3 Mini 3.8B is Microsoft's compact yet powerful language model trained on high-quality synthetic and curated data. It delivers performance that rivals models twice its size, especially in reasoning, math, and coding benchmarks. With support for up to 128K context and a permissive MIT license, Phi-3 Mini is well-suited for on-device and edge deployment. Its small footprint allows it to run on a wide range of consumer hardware while still providing useful outputs for many practical tasks.

Benchmarks

68.8
mmlu