wangclnlp commited on
Commit
5b5261b
·
verified ·
1 Parent(s): 0013266

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -217,6 +217,7 @@ k = 8
217
  res = [pairwise_ranking(user_input, responses[0], responses[1]) for i in range(k)]
218
  print(f"The better response is response{max(set(res), key=res.count)} in {k} votes.")
219
  ```
 
220
 
221
  ### Citation
222
  ```bash
 
217
  res = [pairwise_ranking(user_input, responses[0], responses[1]) for i in range(k)]
218
  print(f"The better response is response{max(set(res), key=res.count)} in {k} votes.")
219
  ```
220
+ Tips: To accelerate inference, GRAM-R^2 can be run with [vLLM](https://github.com/vllm-project/vllm) using multiple processes and threads. We also provide this script as a reference implementation at [this](https://github.com/wangclnlp/GRAM/tree/main/extensions/GRAM-RR).
221
 
222
  ### Citation
223
  ```bash