Update README.md
Browse files
README.md
CHANGED
@@ -175,63 +175,38 @@ missing : 1.26%
|
|
175 |
Here are the results for [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx) vs [model_uint8.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_uint8.onnx):
|
176 |
|
177 |
```
|
178 |
-
|
179 |
-
exact : 20.54%
|
180 |
-
off by 1 : 13.79%
|
181 |
-
off by 2 : 8.55%
|
182 |
-
off by 3 : 6.37%
|
183 |
-
off by 4 : 4.87%
|
184 |
-
off by 5+: 31.53%
|
185 |
-
missing : 14.34%
|
186 |
-
|
187 |
-
Stats for top 20 query results across entire token range:
|
188 |
-
exact : 11.58%
|
189 |
-
off by 1 : 9.46%
|
190 |
-
off by 2 : 6.76%
|
191 |
-
off by 3 : 5.58%
|
192 |
-
off by 4 : 4.70%
|
193 |
-
off by 5+: 38.80%
|
194 |
-
missing : 23.12%
|
195 |
-
|
196 |
-
Stats for top 50 query results across entire token range:
|
197 |
-
exact : 5.34%
|
198 |
-
off by 1 : 5.18%
|
199 |
-
off by 2 : 4.09%
|
200 |
-
off by 3 : 3.60%
|
201 |
-
off by 4 : 3.22%
|
202 |
-
off by 5+: 36.17%
|
203 |
-
missing : 42.38%
|
204 |
```
|
205 |
|
206 |
Here are the results for [model.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model.onnx) vs [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx):
|
207 |
|
208 |
```
|
209 |
-
|
210 |
-
exact :
|
211 |
-
off by 1 :
|
212 |
-
off by 2 :
|
213 |
-
off by 3 :
|
214 |
-
off by 4 :
|
215 |
-
off by 5+:
|
216 |
-
missing :
|
217 |
|
218 |
Stats for top 20 query results across entire token range:
|
219 |
-
exact :
|
220 |
-
off by 1 :
|
221 |
-
off by 2 :
|
222 |
-
off by 3 :
|
223 |
-
off by 4 :
|
224 |
-
off by 5+:
|
225 |
-
missing :
|
226 |
|
227 |
Stats for top 50 query results across entire token range:
|
228 |
-
exact :
|
229 |
-
off by 1 :
|
230 |
-
off by 2 : 3.
|
231 |
-
off by 3 :
|
232 |
-
off by 4 :
|
233 |
-
off by 5+:
|
234 |
-
missing :
|
235 |
```
|
236 |
# Example inference code
|
237 |
|
|
|
175 |
Here are the results for [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx) vs [model_uint8.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_uint8.onnx):
|
176 |
|
177 |
```
|
178 |
+
rechecking ...
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
179 |
```
|
180 |
|
181 |
Here are the results for [model.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model.onnx) vs [model_fp16.onnx](https://huggingface.co/Snowflake/snowflake-arctic-embed-m-v2.0/blob/main/onnx/model_fp16.onnx):
|
182 |
|
183 |
```
|
184 |
+
tats for top 10 query results across entire token range:
|
185 |
+
exact : 86.65%
|
186 |
+
off by 1 : 12.45%
|
187 |
+
off by 2 : 0.44%
|
188 |
+
off by 3 : 0.06%
|
189 |
+
off by 4 : 0.01%
|
190 |
+
off by 5+: 0.01%
|
191 |
+
missing : 0.38%
|
192 |
|
193 |
Stats for top 20 query results across entire token range:
|
194 |
+
exact : 83.34%
|
195 |
+
off by 1 : 14.81%
|
196 |
+
off by 2 : 1.11%
|
197 |
+
off by 3 : 0.20%
|
198 |
+
off by 4 : 0.05%
|
199 |
+
off by 5+: 0.03%
|
200 |
+
missing : 0.47%
|
201 |
|
202 |
Stats for top 50 query results across entire token range:
|
203 |
+
exact : 75.57%
|
204 |
+
off by 1 : 19.34%
|
205 |
+
off by 2 : 3.08%
|
206 |
+
off by 3 : 0.85%
|
207 |
+
off by 4 : 0.28%
|
208 |
+
off by 5+: 0.19%
|
209 |
+
missing : 0.69%
|
210 |
```
|
211 |
# Example inference code
|
212 |
|