Gemma 3 27B

Gemma 3 27B is the flagship of the Gemma 3 family — a multimodal powerhouse that competes with models in the 65B+ class on many benchmarks. It supports 128K context and handles text, images, and complex reasoning tasks with high quality. At Q4 it needs about 20 GB VRAM, fitting well on a RTX 3090/4090 or a Mac with 24 GB+ unified memory. An excellent choice for users who want near-frontier performance from a single consumer GPU.

Compatible Hardware

for Q4_K_M (20 GB VRAM)