nm-testing/Llama-3.2-1B-Instruct-FP8-KV
1B • Updated • 26.6k
Models in CI
Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories.
-
-
nm-testing/Llama-3.2-1B-Instruct-quip-w4a16
2B • Updated • 5.84k -
nm-testing/Llama-3.2-1B-Instruct-spinquantR1R2R4-w4a16
2B • Updated • 5.84k -
nm-testing/Llama3_2_1B_speculator.eagle3
0.4B • Updated • 97.8k -
nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test
Text Generation • 8B • Updated • 17.6k -
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Static-Per-Tensor-Asym
8B • Updated • 101 -
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Static-Per-Tensor-Sym
8B • Updated • 107 -
nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test
Text Generation • 8B • Updated • 24.7k -
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized
47B • Updated • 22 -
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized
47B • Updated • 202 -
nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized
47B • Updated • 17 -
nm-testing/Phi-3-mini-128k-instruct-FP8
4B • Updated • 980 -
nm-testing/Qwen1.5-MoE-A2.7B-Chat-quantized.w4a16
14B • Updated • 68.1k • 1 -
nm-testing/Qwen2-1.5B-Instruct-FP8W8
Text Generation • 2B • Updated • 5.1k -
nm-testing/Qwen3-30B-A3B-FP8-block
Text Generation • 3B • Updated • 5.01k -
nm-testing/Qwen3-30B-A3B-Fp8-v1
31B • Updated • 4.88k -
nm-testing/Qwen3-30B-A3B-MXFP4A16
17B • Updated • 11.2k -
nm-testing/Qwen3-4B-mixed-quant-RTN-wNaM
4B • Updated • 2.48k -
nm-testing/Qwen3-Next-80B-A3B-Instruct-NVFP4
Updated • 1.05k • 2 -
nm-testing/SmolLM-1.7B-Instruct-quantized.w4a16
Text Generation • 2B • Updated • 1.11M -
nm-testing/Speculator-Qwen3-30B-MOE-VL-Eagle3
0.4B • Updated • 763 -
nm-testing/Speculator-Qwen3-8B-Eagle3-converted-071-quantized
1B • Updated • 16k -
nm-testing/Speculator-Qwen3-8B-Eagle3-converted-071-quantized-w4a16
1B • Updated • 6.75k -
nm-testing/SpeculatorLlama3-1-8B-Eagle3-converted-0717-quantized
1.0B • Updated • 16.2k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-compressed
1B • Updated • 1.72k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-uncompressed
1B • Updated • 343 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-MXFP4
0.6B • Updated • 5.7k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4
0.7B • Updated • 18.3k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4A16
0.7B • Updated • 8.65k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-Asym-Updated-ActOrder
1B • Updated • 14.2k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-compressed
1B • Updated • 1.1k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-uncompressed
1B • Updated • 264 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-compressed
1B • Updated • 1.11k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-uncompressed
1B • Updated • 339 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-compressed
1B • Updated • 873 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-uncompressed
1B • Updated • 282 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-attn_head
1B • Updated • 5.33k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-tensor
1B • Updated • 5.67k -
nm-testing/asym-w8w8-int8-static-per-tensor-tiny-llama
1B • Updated • 5.91k -
nm-testing/dflash-qwen3-8b-speculators
2B • Updated • 16.8k -
nm-testing/llama2.c-stories15M
Text Generation • 24.4M • Updated • 9.35k -
nm-testing/llama2.c-stories15M-ultrachat-mixed-compressed
15.2M • Updated • 1.87k -
nm-testing/llama2.c-stories15M-ultrachat-mixed-uncompressed
24.4M • Updated • 2.71k -
nm-testing/llama2.c-stories42M-gsm8k-quantized-only-compressed
58.1M • Updated • 3.11k -
nm-testing/llama2.c-stories42M-gsm8k-quantized-only-uncompressed
58.1M • Updated • 3.04k -
nm-testing/pixtral-12b-FP8-dynamic
Image-Text-to-Text • 13B • Updated • 1.4k • 1 -
nm-testing/qwen3-8b-peagle-speculators
2B • Updated • 20.8k -
nm-testing/test-w4a16-mixtral-actorder-group
47B • Updated • 778 -
nm-testing/tinyllama-fp8-dynamic-compressed
1B • Updated • 996 -
nm-testing/tinyllama-oneshot-w4a16-channel-v2
Text Generation • 1B • Updated • 20.8k • 1 -
nm-testing/tinyllama-oneshot-w4a16-group128-v2
Text Generation • 1B • Updated • 16k -
nm-testing/tinyllama-oneshot-w8-channel-a8-tensor
Text Generation • 1B • Updated • 961 -
nm-testing/tinyllama-oneshot-w8a16-per-channel
Text Generation • 1B • Updated • 933 -
nm-testing/tinyllama-oneshot-w8a8-channel-dynamic-token-v2
Text Generation • 1B • Updated • 13.7k -
nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2
Text Generation • 1B • Updated • 10.9k -
nm-testing/tinyllama-oneshot-w8w8-test-static-shape-change
Text Generation • 1B • Updated • 41.9k -
nm-testing/tinyllama-w4a16-compressed
1B • Updated • 2.18k -
nm-testing/tinyllama-w8a16-dense
1B • Updated • 772 -
nm-testing/tinyllama-w8a8-compressed
1B • Updated • 1.82k -
nm-testing/tinysmokellama-3.2
354k • Updated • 143k -
nm-testing/tinysmokeqwen3
2.64M • Updated • 51.4k -
nm-testing/tinysmokeqwen3moe
2.93M • Updated • 16.1k -
nm-testing/tinysmokeqwen3moe-W4A16-first-only
2.93M • Updated • 7 -
nm-testing/tinysmokeqwen3moe-W4A16-first-only-CTstable
2.93M • Updated • 13.7k -
nm-testing/random-weights-llama3.1.8b-2layer-eagle3-unconverted
1B • Updated • 267 -
nm-testing/Speculator-Qwen3-8B-Eagle3
1B • Updated • 1.34k -
nm-testing/testing-llama3.1.8b-2layer-eagle3
1B • Updated • 605 -
nm-testing/tiny-testing-random-weights
584k • Updated • 3.58k