electroglyph commited on
Commit
986812d
·
verified ·
1 Parent(s): ad485a7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -48
README.md CHANGED
@@ -175,63 +175,38 @@ missing : 1.26%
175
  Here are the results for [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx) vs [model_uint8.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_uint8.onnx):
176
 
177
  ```
178
- Stats for top 10 query results across entire token range:
179
- exact : 20.54%
180
- off by 1 : 13.79%
181
- off by 2 : 8.55%
182
- off by 3 : 6.37%
183
- off by 4 : 4.87%
184
- off by 5+: 31.53%
185
- missing : 14.34%
186
-
187
- Stats for top 20 query results across entire token range:
188
- exact : 11.58%
189
- off by 1 : 9.46%
190
- off by 2 : 6.76%
191
- off by 3 : 5.58%
192
- off by 4 : 4.70%
193
- off by 5+: 38.80%
194
- missing : 23.12%
195
-
196
- Stats for top 50 query results across entire token range:
197
- exact : 5.34%
198
- off by 1 : 5.18%
199
- off by 2 : 4.09%
200
- off by 3 : 3.60%
201
- off by 4 : 3.22%
202
- off by 5+: 36.17%
203
- missing : 42.38%
204
  ```
205
 
206
  Here are the results for [model.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model.onnx) vs [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx):
207
 
208
  ```
209
- Stats for top 10 query results across entire token range:
210
- exact : 18.12%
211
- off by 1 : 11.80%
212
- off by 2 : 7.41%
213
- off by 3 : 5.65%
214
- off by 4 : 4.45%
215
- off by 5+: 32.29%
216
- missing : 20.28%
217
 
218
  Stats for top 20 query results across entire token range:
219
- exact : 10.08%
220
- off by 1 : 7.93%
221
- off by 2 : 5.70%
222
- off by 3 : 4.77%
223
- off by 4 : 4.11%
224
- off by 5+: 37.46%
225
- missing : 29.96%
226
 
227
  Stats for top 50 query results across entire token range:
228
- exact : 4.59%
229
- off by 1 : 4.28%
230
- off by 2 : 3.39%
231
- off by 3 : 3.00%
232
- off by 4 : 2.73%
233
- off by 5+: 33.45%
234
- missing : 48.58%
235
  ```
236
  # Example inference code
237
 
 
175
  Here are the results for [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx) vs [model_uint8.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_uint8.onnx):
176
 
177
  ```
178
+ rechecking ...
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
179
  ```
180
 
181
  Here are the results for [model.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model.onnx) vs [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx):
182
 
183
  ```
184
+ tats for top 10 query results across entire token range:
185
+ exact : 86.65%
186
+ off by 1 : 12.45%
187
+ off by 2 : 0.44%
188
+ off by 3 : 0.06%
189
+ off by 4 : 0.01%
190
+ off by 5+: 0.01%
191
+ missing : 0.38%
192
 
193
  Stats for top 20 query results across entire token range:
194
+ exact : 83.34%
195
+ off by 1 : 14.81%
196
+ off by 2 : 1.11%
197
+ off by 3 : 0.20%
198
+ off by 4 : 0.05%
199
+ off by 5+: 0.03%
200
+ missing : 0.47%
201
 
202
  Stats for top 50 query results across entire token range:
203
+ exact : 75.57%
204
+ off by 1 : 19.34%
205
+ off by 2 : 3.08%
206
+ off by 3 : 0.85%
207
+ off by 4 : 0.28%
208
+ off by 5+: 0.19%
209
+ missing : 0.69%
210
  ```
211
  # Example inference code
212