Quantized Olmo 3 - a kaitchup Collection

kaitchup 's Collections

Quantized Qwen3.8 27B

Quantized Muse Glimmer

Quantized Qwen3.5

Quantized Nanbeige4.1-3B

Quantized GLM4.7 Flash

Quantized translategemma

Quantized LFM2.5

Quantized Qwen3 2512

Quantized K2-V2

Quantized rnj-1

Quantized VibeThinker-1.5B

Quantized Olmo 3

Compressed Tensors Demo

Quantized Qwen3-VL

EoRA Adapters for Qwen2.5 and Qwen3

Quantized Qwen3

2-bit Qwen2.5 72B Instruct

Quantized QwQ 32B

Quantized Phi-4 Mini

Quantized Mistral Small 3

Quantized DeepSeek R1 Distill

Quantized Falcon3

Quantized Llama 3.3

Quantized EuroLLM

Quantized Tulu 3 and OLMo 2

Quantized Qwen2.5

Opus Translation Datasets

Contaminated Mistral 7B and TinyLlama

Llama 3 70B ExLlamaV2 (bpw: 4.0, 3.5, 3.0, 2.5, and 2.18)

[Basics] Quantized Phi-3

[Basics] AutoRound: Llama 3

Quantized Llama 3.1

The Minitron Models and Their Teachers, Quantized

Quantized Olmo 3

updated Dec 15, 2025

Verified models. All compatible with vLLM for very fast inference. Use the 3.1 models as they are more recent.