Skip to content

BigCode · 15B · transformer-decoder

2024-02-28 16K context 15B params

Use Cases

chat code

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_M410.5 GBModerate
Q5_K_M512.0 GBGood
Q8_0rec817.0 GBExcellent

About this model

StarCoder2 15B is the largest model from the BigCode project, trained on The Stack v2 dataset covering over 600 programming languages. It is one of the most capable open code-generation models, excelling at code completion, infilling, and generation across a wide variety of languages. The model supports 16K context and is trained with fill-in-the-middle capabilities, making it particularly effective for IDE-style code completion. Its permissive license and strong benchmark performance make it a solid choice for local coding assistance.

Benchmarks

54.0
mmlu