Mistral 7B

Mistral 7B was a groundbreaking release from Mistral AI that demonstrated 7B parameter models could punch well above their weight class. Using grouped-query attention and sliding window attention, it outperformed larger models like Llama 2 13B on most benchmarks. This model remains a popular choice for local inference due to its excellent performance-to-size ratio. It handles general text generation, coding assistance, and multilingual tasks effectively while running on modest consumer hardware.