unsloth/gemma-4-12b-it-GGUF
Image-Text-to-Text • 12B • Updated • 551k • 791
Gemma 4
Gemma 4 is Google's new model family including including E2B, E4B, 26B-A4B, and 31B.
Note GGUFs to run:
-
unsloth/gemma-4-26B-A4B-it-GGUF
Image-Text-to-Text • 25B • Updated • 1.41M • 1.05k -
unsloth/gemma-4-31B-it-GGUF
Image-Text-to-Text • 31B • Updated • 497k • 572 -
unsloth/gemma-4-E4B-it-GGUF
Image-Text-to-Text • 8B • Updated • 527k • 583 -
unsloth/gemma-4-E2B-it-GGUF
Image-Text-to-Text • 5B • Updated • 429k • 283
unsloth/gemma-4-31B-it-NVFP4
Image-Text-to-Text • 23B • Updated • 40.1k • 31Note NVFP4 for NVIDIA Blackwell GPUs:
-
unsloth/gemma-4-26B-A4B-it-NVFP4
Image-Text-to-Text • 16B • Updated • 171k • 21 -
unsloth/gemma-4-12b-it-NVFP4
Image-Text-to-Text • 8B • Updated • 50.1k • 21
unsloth/gemma-4-26B-A4B-it
Image-Text-to-Text • 27B • Updated • 50.3k • • 27Note 16-bit Instruct safetensors to run and fine-tune with:
-
unsloth/gemma-4-12b-it
Image-Text-to-Text • 12B • Updated • 71.4k • • 17 -
unsloth/gemma-4-31B-it
Image-Text-to-Text • 33B • Updated • 27.2k • 22 -
unsloth/gemma-4-E4B-it
Image-Text-to-Text • 8B • Updated • 67.1k • • 25 -
unsloth/gemma-4-E2B-it
Image-Text-to-Text • 5B • Updated • 64.1k • 13
unsloth/gemma-4-31b-it-UD-MLX-4bit
Image-Text-to-Text • 7B • Updated • 811 • 28Note MLX for MacOS devices:
-
unsloth/gemma-4-E4B-it-MLX-8bit
Image-Text-to-Text • 3B • Updated • 772 • 12 -
unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit
Image-Text-to-Text • 5B • Updated • 1.55k • 34 -
unsloth/gemma-4-26b-a4b-it-MLX-8bit
Image-Text-to-Text • 8B • Updated • 966 • 16 -
unsloth/gemma-4-31b-it-MLX-8bit
Image-Text-to-Text • 9B • Updated • 992 • 15 -
unsloth/gemma-4-E2B-it-MLX-8bit
Image-Text-to-Text • 1B • Updated • 497 • 8 -
unsloth/gemma-4-E4B-it-UD-MLX-4bit
Image-Text-to-Text • 2B • Updated • 1.53k • 45 -
unsloth/gemma-4-E2B-it-UD-MLX-4bit
Image-Text-to-Text • 1B • Updated • 1.13k • 23 -
unsloth/gemma-4-26b-a4b-it-UD-MLX-3bit
Image-Text-to-Text • 4B • Updated • 482 • 8 -
unsloth/gemma-4-31b-it-UD-MLX-3bit
Image-Text-to-Text • 6B • Updated • 298 • 7
unsloth/gemma-4-31B-it-unsloth-bnb-4bit
Image-Text-to-Text • 31B • Updated • 103k • 22Note Dynamic 4-bit Bitsandbytes to fine-tune with:
-
unsloth/gemma-4-E4B-it-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 573k • 22 -
unsloth/gemma-4-E2B-it-unsloth-bnb-4bit
Image-Text-to-Text • 5B • Updated • 75k • 9
unsloth/gemma-4-26B-A4B
Image-Text-to-Text • 27B • Updated • 3.35k • 19Note 16-bit BASE safetensors to run and fine-tune in Unsloth Studio:
-
unsloth/gemma-4-12b
Image-Text-to-Text • 12B • Updated • 4.7k • 18 -
unsloth/gemma-4-E4B
Image-Text-to-Text • 8B • Updated • 1.53k • 10 -
unsloth/gemma-4-E2B
Image-Text-to-Text • 5B • Updated • 3.95k • 11 -
unsloth/gemma-4-31B
Image-Text-to-Text • 33B • Updated • 1.76k • 19
unsloth/gemma-4-31B-unsloth-bnb-4bit
31B • Updated • 1.41k • 4Note Dynamic 4-bit BASE Bitsandbytes to fine-tune with:
-
unsloth/gemma-4-E4B-unsloth-bnb-4bit
8B • Updated • 4.06k • 2 -
unsloth/gemma-4-E2B-unsloth-bnb-4bit
5B • Updated • 3.03k • 5
unsloth/gemma-4-26B-A4B-it-qat-GGUF
Image-Text-to-Text • 25B • Updated • 357k • 370Note QAT:
-
unsloth/gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 283k • 405 -
unsloth/gemma-4-31B-it-qat-GGUF
Image-Text-to-Text • 31B • Updated • 215k • 175 -
unsloth/gemma-4-E2B-it-qat-GGUF
Any-to-Any • 5B • Updated • 149k • 70 -
unsloth/gemma-4-E4B-it-qat-GGUF
Any-to-Any • 7B • Updated • 317k • 153 -
unsloth/gemma-4-E2B-it-qat-mobile-GGUF
Any-to-Any • 5B • Updated • 41.8k • 34 -
unsloth/gemma-4-E4B-it-qat-mobile-GGUF
Any-to-Any • 7B • Updated • 17.7k • 27 -
unsloth/gemma-4-E4B-it-NVFP4
Image-Text-to-Text • 7B • Updated • 22.1k • 11 -
unsloth/gemma-4-E2B-it-NVFP4
Image-Text-to-Text • 5B • Updated • 5.43k • 8