Update README.md
Browse files
README.md
CHANGED
@@ -9,4 +9,4 @@ library_name: transformers
|
|
9 |
base_model:
|
10 |
- Steelskull/L3.3-MS-Nevoria-70b
|
11 |
---
|
12 |
-
This is a checkpoint for quantization using
|
|
|
9 |
base_model:
|
10 |
- Steelskull/L3.3-MS-Nevoria-70b
|
11 |
---
|
12 |
+
This is a checkpoint for quantization using tensor-model-optimizer, it is a static FP8 checkpoint, supporting vllm, sglang inference.
|