QuantTrio
/

GLM-4.5-Air-GPTQ-Int4-Int8Mix

Text Generation

quantization fix

4-bit precision

Model card Files Files and versions Community

JunHowie commited on 23 days ago

Commit

e20c7d1

·

verified ·

1 Parent(s): 1c4a9bf

Update README.md

Files changed (1) hide show

README.md +13 -13

README.md CHANGED Viewed

@@ -1,16 +1,16 @@
-  ---
-  library_name: transformers
-  pipeline_tag: text-generation
-  tags:
-  - glm4_moe
-  - GPTQ
-  - Int4-Int8Mix
-  - quantization fix
-  - vLLM
-  base_model:
-    - zai-org/GLM-4.5-Air
-  base_model_relation: quantized
-  ---
   # GLM-4.5-Air-GPTQ-Int4-Int8Mix

+---
+library_name: transformers
+pipeline_tag: text-generation
+tags:
+- glm4_moe
+- AWQ
+- FP16Mix
+- quantization fix
+- vLLM
+base_model:
+  - zai-org/GLM-4.5-Air
+base_model_relation: quantized
+---
   # GLM-4.5-Air-GPTQ-Int4-Int8Mix