Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -30,7 +30,7 @@ vllm serve $model_id \
|
|
| 30 |
- SGLang
|
| 31 |
|
| 32 |
```bash
|
| 33 |
-
|
| 34 |
model_id=tiny-random/glm-4.5
|
| 35 |
python3 -m sglang.launch_server \
|
| 36 |
--model-path $model_id \
|
|
|
|
| 30 |
- SGLang
|
| 31 |
|
| 32 |
```bash
|
| 33 |
+
# Multi-token prediction is supported
|
| 34 |
model_id=tiny-random/glm-4.5
|
| 35 |
python3 -m sglang.launch_server \
|
| 36 |
--model-path $model_id \
|