Update README.md

README.md

@@ -13,6 +13,36 @@ pipeline_tag: document-question-answering
 
 Idefices2 8B fine-tuned on 800+ multi-page documents for Visual DocQA. Make sure you have the latest peft and transformers before loading the model. GPU is required for it to work properly.
 
+Compared to the base model, it has a lower edit distance (53% improvement on micro average) on the test set.
+
+|    | Category                    |   Idefics2-8B |   Idefics2-8B-EDGAR | Δ(↑)   |
+|---:|:----------------------------|--------------:|--------------------:|:-------|
+|  0 | agreement_date              |      0.878489 |           0.0999479 | 88.62% |
+|  1 | agreement_term              |      0.907067 |           0.438816  | 51.62% |
+|  2 | auto_renewal                |      0.634946 |           0.0516129 | 91.87% |
+|  3 | contract_value              |      0.474438 |           0.418815  | 11.72% |
+|  4 | counterparty_address        |      0.771387 |           0.59835   | 22.43% |
+|  5 | counterparty_name           |      0.825491 |           0.633359  | 23.27% |
+|  6 | counterparty_signer_name    |      0.842091 |           0.480444  | 42.95% |
+|  7 | counterparty_signer_title   |      0.61746  |           0.496041  | 19.66% |
+|  8 | effective_date              |      0.903268 |           0.125641  | 86.09% |
+|  9 | expiration_date             |      0.88673  |           0.235197  | 73.48% |
+| 10 | governing_law               |      0.881037 |           0.308771  | 64.95% |
+| 11 | opt_out_length              |      0.431548 |           0.047619  | 88.97% |
+| 12 | party_address               |      0.730897 |           0.608301  | 16.77% |
+| 13 | party_name                  |      0.726411 |           0.490194  | 32.52% |
+| 14 | payment_frequency           |      0.686123 |           0.373724  | 45.53% |
+| 15 | payment_term                |      0.854552 |           0.593333  | 30.57% |
+| 16 | renewal_term                |      0.92829  |           0.0595238 | 93.59% |
+| 17 | termination_for_cause       |      0.436    |           0.048     | 88.99% |
+| 18 | termination_for_convenience |      0.628261 |           0.156522  | 75.09% |
+| 19 | termination_notice_period   |      0.329748 |           0.178394  | 45.90% |
+| 20 | venue                       |      0.781417 |           0.61403   | 21.42% |
+
+
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/607a5b44489fc71534e91c0e/3Jc7I1Fj2J3rabos2HLyY.png)
+
 ## Model Details
 
 ### Model Description
@@ -137,14 +167,14 @@ TODO
 
 #### Testing Data
 
-TODO
+20% percent of the whole dataset.
 
 #### Metrics
 
-TODO
+Edit Distance (nltk).
 
 ### Results
 
-TODO
+See above.
 
 #### Summary