alexmarques commited on
Commit
ac5fff4
·
verified ·
1 Parent(s): 83fb9f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -158,7 +158,7 @@ The model was evaluated on the [OpenLLM](https://huggingface.co/spaces/open-llm-
158
  ```
159
  lm_eval \
160
  --model vllm \
161
- --model_args pretrained="neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a16",dtype=auto,gpu_memory_utilization=0.4,add_bos_token=True,max_model_len=4096 \
162
  --tasks openllm \
163
  --batch_size auto
164
  ```
 
158
  ```
159
  lm_eval \
160
  --model vllm \
161
+ --model_args pretrained="neuralmagic/Phi-3-mini-128k-instruct-quantized.w8a16",dtype=auto,gpu_memory_utilization=0.4,add_bos_token=True,max_model_len=4096,tensor_parallel_size=1 \
162
  --tasks openllm \
163
  --batch_size auto
164
  ```