Update README.md
Browse files
README.md
CHANGED
@@ -158,7 +158,7 @@ The model was evaluated on the [OpenLLM](https://huggingface.co/spaces/open-llm-
|
|
158 |
```
|
159 |
lm_eval \
|
160 |
--model vllm \
|
161 |
-
--model_args pretrained="neuralmagic/
|
162 |
--tasks openllm \
|
163 |
--batch_size auto
|
164 |
```
|
|
|
158 |
```
|
159 |
lm_eval \
|
160 |
--model vllm \
|
161 |
+
--model_args pretrained="neuralmagic/Phi-3-mini-128k-instruct-quantized.w8a16",dtype=auto,gpu_memory_utilization=0.4,add_bos_token=True,max_model_len=4096,tensor_parallel_size=1 \
|
162 |
--tasks openllm \
|
163 |
--batch_size auto
|
164 |
```
|