Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -217,6 +217,7 @@ k = 8
|
|
217 |
res = [pairwise_ranking(user_input, responses[0], responses[1]) for i in range(k)]
|
218 |
print(f"The better response is response{max(set(res), key=res.count)} in {k} votes.")
|
219 |
```
|
|
|
220 |
|
221 |
### Citation
|
222 |
```bash
|
|
|
217 |
res = [pairwise_ranking(user_input, responses[0], responses[1]) for i in range(k)]
|
218 |
print(f"The better response is response{max(set(res), key=res.count)} in {k} votes.")
|
219 |
```
|
220 |
+
Tips: To accelerate inference, GRAM-R^2 can be run with [vLLM](https://github.com/vllm-project/vllm) using multiple processes and threads. We also provide this script as a reference implementation at [this](https://github.com/wangclnlp/GRAM/tree/main/extensions/GRAM-RR).
|
221 |
|
222 |
### Citation
|
223 |
```bash
|