Model save
Browse files
README.md
CHANGED
|
@@ -17,6 +17,29 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 17 |
# DeepSeek-R1-Distill-Qwen-1.5B-2-contract-sections-classification-v4-50
|
| 18 |
|
| 19 |
This model is a fine-tuned version of [deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) on an unknown dataset.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
## Model description
|
| 22 |
|
|
@@ -44,6 +67,62 @@ The following hyperparameters were used during training:
|
|
| 44 |
- num_epochs: 50
|
| 45 |
- mixed_precision_training: Native AMP
|
| 46 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 47 |
### Framework versions
|
| 48 |
|
| 49 |
- PEFT 0.14.0
|
|
|
|
| 17 |
# DeepSeek-R1-Distill-Qwen-1.5B-2-contract-sections-classification-v4-50
|
| 18 |
|
| 19 |
This model is a fine-tuned version of [deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) on an unknown dataset.
|
| 20 |
+
It achieves the following results on the evaluation set:
|
| 21 |
+
- Loss: 0.7779
|
| 22 |
+
- Accuracy Evaluate: 0.7572
|
| 23 |
+
- Precision Evaluate: 0.7826
|
| 24 |
+
- Recall Evaluate: 0.7485
|
| 25 |
+
- F1 Evaluate: 0.7579
|
| 26 |
+
- Accuracy Sklearn: 0.7572
|
| 27 |
+
- Precision Sklearn: 0.7707
|
| 28 |
+
- Recall Sklearn: 0.7572
|
| 29 |
+
- F1 Sklearn: 0.7558
|
| 30 |
+
- Acuracia Rotulo Objeto: 0.8533
|
| 31 |
+
- Acuracia Rotulo Obrigacoes: 0.8148
|
| 32 |
+
- Acuracia Rotulo Valor: 0.5874
|
| 33 |
+
- Acuracia Rotulo Vigencia: 0.7900
|
| 34 |
+
- Acuracia Rotulo Rescisao: 0.8698
|
| 35 |
+
- Acuracia Rotulo Foro: 0.8846
|
| 36 |
+
- Acuracia Rotulo Reajuste: 0.4448
|
| 37 |
+
- Acuracia Rotulo Fiscalizacao: 0.7066
|
| 38 |
+
- Acuracia Rotulo Publicacao: 0.8227
|
| 39 |
+
- Acuracia Rotulo Pagamento: 0.7065
|
| 40 |
+
- Acuracia Rotulo Casos Omissos: 0.7833
|
| 41 |
+
- Acuracia Rotulo Sancoes: 0.7523
|
| 42 |
+
- Acuracia Rotulo Dotacao Orcamentaria: 0.7143
|
| 43 |
|
| 44 |
## Model description
|
| 45 |
|
|
|
|
| 67 |
- num_epochs: 50
|
| 68 |
- mixed_precision_training: Native AMP
|
| 69 |
|
| 70 |
+
### Training results
|
| 71 |
+
|
| 72 |
+
| Training Loss | Epoch | Step | Validation Loss | Accuracy Evaluate | Precision Evaluate | Recall Evaluate | F1 Evaluate | Accuracy Sklearn | Precision Sklearn | Recall Sklearn | F1 Sklearn | Acuracia Rotulo Objeto | Acuracia Rotulo Obrigacoes | Acuracia Rotulo Valor | Acuracia Rotulo Vigencia | Acuracia Rotulo Rescisao | Acuracia Rotulo Foro | Acuracia Rotulo Reajuste | Acuracia Rotulo Fiscalizacao | Acuracia Rotulo Publicacao | Acuracia Rotulo Pagamento | Acuracia Rotulo Casos Omissos | Acuracia Rotulo Sancoes | Acuracia Rotulo Dotacao Orcamentaria |
|
| 73 |
+
|:-------------:|:-----:|:-----:|:---------------:|:-----------------:|:------------------:|:---------------:|:-----------:|:----------------:|:-----------------:|:--------------:|:----------:|:----------------------:|:--------------------------:|:---------------------:|:------------------------:|:------------------------:|:--------------------:|:------------------------:|:----------------------------:|:--------------------------:|:-------------------------:|:-----------------------------:|:-----------------------:|:------------------------------------:|
|
| 74 |
+
| 3.6058 | 1.0 | 1000 | 3.6431 | 0.0833 | 0.0867 | 0.0997 | 0.0803 | 0.0833 | 0.0840 | 0.0833 | 0.0689 | 0.1012 | 0.0017 | 0.0287 | 0.0 | 0.0 | 0.0077 | 0.0 | 0.3754 | 0.0148 | 0.1377 | 0.3153 | 0.1376 | 0.1758 |
|
| 75 |
+
| 3.1567 | 2.0 | 2000 | 3.2332 | 0.105 | 0.1131 | 0.1192 | 0.1040 | 0.105 | 0.1103 | 0.105 | 0.0956 | 0.1591 | 0.0084 | 0.0315 | 0.0 | 0.1163 | 0.0077 | 0.0036 | 0.4069 | 0.0542 | 0.0435 | 0.3842 | 0.1193 | 0.2143 |
|
| 76 |
+
| 2.6852 | 3.0 | 3000 | 2.8814 | 0.1522 | 0.1610 | 0.1554 | 0.1503 | 0.1522 | 0.1622 | 0.1522 | 0.1503 | 0.2045 | 0.1650 | 0.0458 | 0.0105 | 0.1524 | 0.0077 | 0.0890 | 0.4353 | 0.0739 | 0.0072 | 0.5222 | 0.0917 | 0.2143 |
|
| 77 |
+
| 2.384 | 4.0 | 4000 | 2.6817 | 0.2023 | 0.1959 | 0.1926 | 0.1886 | 0.2023 | 0.2023 | 0.2023 | 0.1961 | 0.2107 | 0.3333 | 0.1977 | 0.0551 | 0.1773 | 0.0077 | 0.1032 | 0.4259 | 0.1823 | 0.0109 | 0.5172 | 0.1009 | 0.1813 |
|
| 78 |
+
| 2.1617 | 5.0 | 5000 | 2.5358 | 0.2582 | 0.2607 | 0.2501 | 0.2496 | 0.2582 | 0.2636 | 0.2582 | 0.2546 | 0.2314 | 0.3923 | 0.2923 | 0.2310 | 0.2078 | 0.0077 | 0.1495 | 0.4006 | 0.4433 | 0.0145 | 0.5271 | 0.1835 | 0.1703 |
|
| 79 |
+
| 1.9661 | 6.0 | 6000 | 2.4124 | 0.2888 | 0.2937 | 0.2757 | 0.2791 | 0.2888 | 0.2969 | 0.2888 | 0.2866 | 0.2583 | 0.4175 | 0.3410 | 0.3911 | 0.2271 | 0.0077 | 0.1530 | 0.3975 | 0.4384 | 0.0254 | 0.5271 | 0.2018 | 0.1978 |
|
| 80 |
+
| 1.8089 | 7.0 | 7000 | 2.3042 | 0.3192 | 0.3294 | 0.3012 | 0.3074 | 0.3192 | 0.3326 | 0.3192 | 0.3171 | 0.3574 | 0.4478 | 0.3639 | 0.4619 | 0.2271 | 0.0538 | 0.1530 | 0.3754 | 0.4680 | 0.0326 | 0.5567 | 0.2202 | 0.1978 |
|
| 81 |
+
| 1.6701 | 8.0 | 8000 | 2.2086 | 0.339 | 0.3499 | 0.3171 | 0.3258 | 0.339 | 0.3525 | 0.339 | 0.3374 | 0.3781 | 0.4798 | 0.3668 | 0.4934 | 0.2327 | 0.1231 | 0.1495 | 0.4385 | 0.4532 | 0.0362 | 0.5567 | 0.2110 | 0.2033 |
|
| 82 |
+
| 1.5685 | 9.0 | 9000 | 2.1203 | 0.3655 | 0.3782 | 0.3450 | 0.3537 | 0.3655 | 0.3813 | 0.3655 | 0.3652 | 0.4008 | 0.4933 | 0.3725 | 0.5223 | 0.2493 | 0.2577 | 0.1779 | 0.4290 | 0.5123 | 0.0942 | 0.5517 | 0.2202 | 0.2033 |
|
| 83 |
+
| 1.4365 | 10.0 | 10000 | 2.0378 | 0.381 | 0.4018 | 0.3609 | 0.3706 | 0.381 | 0.3993 | 0.381 | 0.3795 | 0.4298 | 0.5168 | 0.3754 | 0.5223 | 0.2770 | 0.3615 | 0.1886 | 0.3880 | 0.5172 | 0.0942 | 0.5567 | 0.2661 | 0.1978 |
|
| 84 |
+
| 1.3303 | 11.0 | 11000 | 1.9616 | 0.4035 | 0.4253 | 0.3855 | 0.3932 | 0.4035 | 0.4230 | 0.4035 | 0.4018 | 0.4607 | 0.5471 | 0.3725 | 0.5328 | 0.3102 | 0.4231 | 0.1922 | 0.4069 | 0.5172 | 0.1087 | 0.5567 | 0.3578 | 0.2253 |
|
| 85 |
+
| 1.2351 | 12.0 | 12000 | 1.8884 | 0.422 | 0.4513 | 0.4046 | 0.4138 | 0.422 | 0.4478 | 0.422 | 0.4214 | 0.4876 | 0.5640 | 0.3782 | 0.5407 | 0.3435 | 0.4462 | 0.1993 | 0.4164 | 0.5714 | 0.1268 | 0.5567 | 0.3761 | 0.2527 |
|
| 86 |
+
| 1.159 | 13.0 | 13000 | 1.8222 | 0.4432 | 0.4722 | 0.4252 | 0.4336 | 0.4432 | 0.4700 | 0.4432 | 0.4425 | 0.5041 | 0.6094 | 0.3954 | 0.5354 | 0.3712 | 0.5115 | 0.2135 | 0.4196 | 0.5764 | 0.1341 | 0.5616 | 0.4037 | 0.2912 |
|
| 87 |
+
| 1.0561 | 14.0 | 14000 | 1.7594 | 0.4662 | 0.4899 | 0.4474 | 0.4550 | 0.4662 | 0.4845 | 0.4662 | 0.4624 | 0.5248 | 0.6633 | 0.4011 | 0.5459 | 0.3961 | 0.5654 | 0.2135 | 0.4196 | 0.5813 | 0.1486 | 0.6108 | 0.4495 | 0.2967 |
|
| 88 |
+
| 0.9931 | 15.0 | 15000 | 1.6960 | 0.4895 | 0.5135 | 0.4754 | 0.4802 | 0.4895 | 0.5087 | 0.4895 | 0.4856 | 0.5517 | 0.6751 | 0.4040 | 0.5512 | 0.4211 | 0.6077 | 0.2171 | 0.4353 | 0.5911 | 0.1703 | 0.7340 | 0.4862 | 0.3352 |
|
| 89 |
+
| 0.9236 | 16.0 | 16000 | 1.6330 | 0.5175 | 0.5376 | 0.5031 | 0.5066 | 0.5175 | 0.5327 | 0.5175 | 0.5122 | 0.5992 | 0.6919 | 0.4011 | 0.5617 | 0.5402 | 0.6615 | 0.2206 | 0.4511 | 0.5813 | 0.1812 | 0.7340 | 0.5596 | 0.3571 |
|
| 90 |
+
| 0.8721 | 17.0 | 17000 | 1.5697 | 0.5312 | 0.5486 | 0.5168 | 0.5201 | 0.5312 | 0.5434 | 0.5312 | 0.5252 | 0.6302 | 0.7020 | 0.4097 | 0.5617 | 0.5568 | 0.6808 | 0.2278 | 0.4606 | 0.5813 | 0.2065 | 0.7389 | 0.5780 | 0.3846 |
|
| 91 |
+
| 0.7728 | 18.0 | 18000 | 1.5073 | 0.55 | 0.5691 | 0.5361 | 0.5396 | 0.55 | 0.5623 | 0.55 | 0.5436 | 0.6508 | 0.7256 | 0.4355 | 0.5669 | 0.5679 | 0.7115 | 0.2242 | 0.4669 | 0.5961 | 0.2572 | 0.7488 | 0.6055 | 0.4121 |
|
| 92 |
+
| 0.736 | 19.0 | 19000 | 1.4442 | 0.5655 | 0.5900 | 0.5524 | 0.5576 | 0.5655 | 0.5802 | 0.5655 | 0.5594 | 0.6736 | 0.7407 | 0.4384 | 0.5853 | 0.5817 | 0.7192 | 0.2420 | 0.4795 | 0.5961 | 0.2899 | 0.7488 | 0.6514 | 0.4341 |
|
| 93 |
+
| 0.6875 | 20.0 | 20000 | 1.3848 | 0.5825 | 0.6068 | 0.5702 | 0.5743 | 0.5825 | 0.5971 | 0.5825 | 0.5759 | 0.6963 | 0.7441 | 0.4441 | 0.6325 | 0.6011 | 0.7462 | 0.2456 | 0.4953 | 0.6010 | 0.3007 | 0.7537 | 0.6789 | 0.4725 |
|
| 94 |
+
| 0.6262 | 21.0 | 21000 | 1.3289 | 0.5962 | 0.6314 | 0.5844 | 0.5930 | 0.5962 | 0.6158 | 0.5962 | 0.5915 | 0.7025 | 0.7475 | 0.4527 | 0.6457 | 0.6205 | 0.7846 | 0.2456 | 0.5047 | 0.6059 | 0.3623 | 0.7685 | 0.6789 | 0.4780 |
|
| 95 |
+
| 0.6057 | 22.0 | 22000 | 1.2743 | 0.6115 | 0.6451 | 0.6005 | 0.6088 | 0.6115 | 0.6286 | 0.6115 | 0.6064 | 0.7149 | 0.7525 | 0.4556 | 0.6745 | 0.6648 | 0.8 | 0.2491 | 0.5174 | 0.6059 | 0.3804 | 0.7685 | 0.7064 | 0.5165 |
|
| 96 |
+
| 0.5566 | 23.0 | 23000 | 1.2238 | 0.6262 | 0.6620 | 0.6144 | 0.6239 | 0.6262 | 0.6439 | 0.6262 | 0.6208 | 0.7211 | 0.7778 | 0.4756 | 0.6903 | 0.6870 | 0.8115 | 0.2491 | 0.5300 | 0.6010 | 0.4022 | 0.7734 | 0.7248 | 0.5440 |
|
| 97 |
+
| 0.5144 | 24.0 | 24000 | 1.1794 | 0.6418 | 0.6778 | 0.6279 | 0.6377 | 0.6418 | 0.6606 | 0.6418 | 0.6358 | 0.7438 | 0.8030 | 0.4871 | 0.7034 | 0.7202 | 0.8154 | 0.2527 | 0.5426 | 0.6207 | 0.4058 | 0.7734 | 0.7339 | 0.5604 |
|
| 98 |
+
| 0.4857 | 25.0 | 25000 | 1.1356 | 0.6538 | 0.6921 | 0.6387 | 0.6494 | 0.6538 | 0.6730 | 0.6538 | 0.6472 | 0.7583 | 0.8182 | 0.4957 | 0.7192 | 0.7396 | 0.8308 | 0.2491 | 0.5615 | 0.6207 | 0.4167 | 0.7734 | 0.7431 | 0.5769 |
|
| 99 |
+
| 0.4689 | 26.0 | 26000 | 1.0982 | 0.6655 | 0.7029 | 0.6514 | 0.6619 | 0.6655 | 0.6853 | 0.6655 | 0.6601 | 0.7707 | 0.8165 | 0.5043 | 0.7323 | 0.7562 | 0.8385 | 0.2883 | 0.5678 | 0.6305 | 0.4384 | 0.7734 | 0.7523 | 0.5989 |
|
| 100 |
+
| 0.4349 | 27.0 | 27000 | 1.0615 | 0.6717 | 0.7090 | 0.6569 | 0.6675 | 0.6717 | 0.6901 | 0.6717 | 0.6651 | 0.7769 | 0.8215 | 0.5072 | 0.7428 | 0.7839 | 0.8423 | 0.2633 | 0.5678 | 0.6650 | 0.4529 | 0.7734 | 0.7431 | 0.5989 |
|
| 101 |
+
| 0.4135 | 28.0 | 28000 | 1.0305 | 0.679 | 0.7174 | 0.6656 | 0.6772 | 0.679 | 0.6979 | 0.679 | 0.6738 | 0.7810 | 0.8148 | 0.5129 | 0.7559 | 0.7867 | 0.8462 | 0.2918 | 0.5741 | 0.6798 | 0.4746 | 0.7734 | 0.7523 | 0.6099 |
|
| 102 |
+
| 0.3983 | 29.0 | 29000 | 1.0026 | 0.6893 | 0.7268 | 0.6774 | 0.6895 | 0.6893 | 0.7091 | 0.6893 | 0.6862 | 0.7851 | 0.8165 | 0.5186 | 0.7612 | 0.7895 | 0.8538 | 0.3665 | 0.5741 | 0.6847 | 0.4964 | 0.7685 | 0.7706 | 0.6209 |
|
| 103 |
+
| 0.3896 | 30.0 | 30000 | 0.9751 | 0.6993 | 0.7357 | 0.6875 | 0.7000 | 0.6993 | 0.7174 | 0.6993 | 0.6962 | 0.7955 | 0.8232 | 0.5244 | 0.7612 | 0.8089 | 0.8577 | 0.3772 | 0.5804 | 0.7143 | 0.5181 | 0.7833 | 0.7615 | 0.6319 |
|
| 104 |
+
| 0.3565 | 31.0 | 31000 | 0.9522 | 0.6995 | 0.7356 | 0.6888 | 0.7010 | 0.6995 | 0.7176 | 0.6995 | 0.6969 | 0.7996 | 0.8081 | 0.5244 | 0.7664 | 0.8089 | 0.8577 | 0.3843 | 0.5836 | 0.7192 | 0.5254 | 0.7833 | 0.7615 | 0.6319 |
|
| 105 |
+
| 0.3465 | 32.0 | 32000 | 0.9295 | 0.7065 | 0.7412 | 0.6948 | 0.7068 | 0.7065 | 0.7240 | 0.7065 | 0.7035 | 0.8120 | 0.8114 | 0.5272 | 0.7717 | 0.8283 | 0.8692 | 0.3843 | 0.5836 | 0.7192 | 0.5471 | 0.7833 | 0.7523 | 0.6429 |
|
| 106 |
+
| 0.3439 | 33.0 | 33000 | 0.9106 | 0.7145 | 0.7496 | 0.7068 | 0.7176 | 0.7145 | 0.7318 | 0.7145 | 0.7120 | 0.8099 | 0.8047 | 0.5301 | 0.7717 | 0.8338 | 0.8692 | 0.3915 | 0.5836 | 0.8227 | 0.5761 | 0.7833 | 0.7523 | 0.6593 |
|
| 107 |
+
| 0.3214 | 34.0 | 34000 | 0.8929 | 0.7192 | 0.7523 | 0.7109 | 0.7217 | 0.7192 | 0.7355 | 0.7192 | 0.7168 | 0.8182 | 0.8098 | 0.5358 | 0.7717 | 0.8338 | 0.8692 | 0.3950 | 0.5899 | 0.8374 | 0.5942 | 0.7783 | 0.7431 | 0.6648 |
|
| 108 |
+
| 0.3192 | 35.0 | 35000 | 0.8767 | 0.7248 | 0.7545 | 0.7170 | 0.7267 | 0.7248 | 0.7393 | 0.7248 | 0.7224 | 0.8120 | 0.8148 | 0.5415 | 0.7743 | 0.8393 | 0.8692 | 0.3986 | 0.5931 | 0.8374 | 0.6377 | 0.7783 | 0.7431 | 0.6813 |
|
| 109 |
+
| 0.3061 | 36.0 | 36000 | 0.8628 | 0.729 | 0.7584 | 0.7216 | 0.7308 | 0.729 | 0.7438 | 0.729 | 0.7267 | 0.8161 | 0.8199 | 0.5473 | 0.7717 | 0.8421 | 0.8769 | 0.4021 | 0.5931 | 0.8424 | 0.6522 | 0.7783 | 0.7523 | 0.6868 |
|
| 110 |
+
| 0.3037 | 37.0 | 37000 | 0.8495 | 0.7378 | 0.7643 | 0.7306 | 0.7389 | 0.7378 | 0.7501 | 0.7378 | 0.7351 | 0.8182 | 0.8182 | 0.5501 | 0.7743 | 0.8421 | 0.8808 | 0.4021 | 0.6877 | 0.8424 | 0.6558 | 0.7783 | 0.7615 | 0.6868 |
|
| 111 |
+
| 0.3004 | 38.0 | 38000 | 0.8389 | 0.738 | 0.7631 | 0.7300 | 0.7382 | 0.738 | 0.7510 | 0.738 | 0.7357 | 0.8244 | 0.8114 | 0.5501 | 0.7822 | 0.8476 | 0.8808 | 0.4128 | 0.6909 | 0.7980 | 0.6594 | 0.7783 | 0.7615 | 0.6923 |
|
| 112 |
+
| 0.2922 | 39.0 | 39000 | 0.8277 | 0.7438 | 0.7707 | 0.7365 | 0.7453 | 0.7438 | 0.7570 | 0.7438 | 0.7417 | 0.8306 | 0.8131 | 0.5530 | 0.7822 | 0.8532 | 0.8808 | 0.4270 | 0.6940 | 0.8424 | 0.6667 | 0.7783 | 0.7615 | 0.6923 |
|
| 113 |
+
| 0.2897 | 40.0 | 40000 | 0.8186 | 0.7478 | 0.7749 | 0.7406 | 0.7495 | 0.7478 | 0.7610 | 0.7478 | 0.7457 | 0.8430 | 0.8114 | 0.5530 | 0.7874 | 0.8560 | 0.8846 | 0.4270 | 0.6940 | 0.8473 | 0.6812 | 0.7833 | 0.7615 | 0.6978 |
|
| 114 |
+
| 0.2717 | 41.0 | 41000 | 0.8093 | 0.7515 | 0.7782 | 0.7436 | 0.7530 | 0.7515 | 0.7644 | 0.7515 | 0.7496 | 0.8450 | 0.8148 | 0.5645 | 0.7874 | 0.8587 | 0.8808 | 0.4342 | 0.7035 | 0.8473 | 0.6920 | 0.7833 | 0.7523 | 0.7033 |
|
| 115 |
+
| 0.2735 | 42.0 | 42000 | 0.8028 | 0.751 | 0.7761 | 0.7424 | 0.7516 | 0.751 | 0.7638 | 0.751 | 0.7492 | 0.8450 | 0.8148 | 0.5673 | 0.7874 | 0.8587 | 0.8808 | 0.4342 | 0.7066 | 0.8128 | 0.6993 | 0.7833 | 0.7523 | 0.7088 |
|
| 116 |
+
| 0.2704 | 43.0 | 43000 | 0.7974 | 0.7518 | 0.7773 | 0.7432 | 0.7525 | 0.7518 | 0.7649 | 0.7518 | 0.7501 | 0.8450 | 0.8148 | 0.5731 | 0.7874 | 0.8615 | 0.8808 | 0.4342 | 0.7066 | 0.8177 | 0.6957 | 0.7833 | 0.7523 | 0.7088 |
|
| 117 |
+
| 0.2624 | 44.0 | 44000 | 0.7917 | 0.7538 | 0.7793 | 0.7453 | 0.7547 | 0.7538 | 0.7670 | 0.7538 | 0.7523 | 0.8450 | 0.8131 | 0.5817 | 0.7900 | 0.8670 | 0.8808 | 0.4377 | 0.7035 | 0.8227 | 0.7029 | 0.7833 | 0.7523 | 0.7088 |
|
| 118 |
+
| 0.2642 | 45.0 | 45000 | 0.7875 | 0.7568 | 0.7838 | 0.7495 | 0.7588 | 0.7568 | 0.7703 | 0.7568 | 0.7553 | 0.8450 | 0.8131 | 0.5817 | 0.7900 | 0.8670 | 0.8846 | 0.4413 | 0.7066 | 0.8670 | 0.7029 | 0.7833 | 0.7523 | 0.7088 |
|
| 119 |
+
| 0.2723 | 46.0 | 46000 | 0.7841 | 0.7555 | 0.7807 | 0.7471 | 0.7564 | 0.7555 | 0.7689 | 0.7555 | 0.7541 | 0.8471 | 0.8148 | 0.5817 | 0.7900 | 0.8670 | 0.8846 | 0.4448 | 0.7066 | 0.8227 | 0.7029 | 0.7833 | 0.7523 | 0.7143 |
|
| 120 |
+
| 0.2538 | 47.0 | 47000 | 0.7811 | 0.7558 | 0.7802 | 0.7472 | 0.7562 | 0.7558 | 0.7687 | 0.7558 | 0.7542 | 0.8492 | 0.8148 | 0.5817 | 0.7900 | 0.8670 | 0.8846 | 0.4448 | 0.7066 | 0.8227 | 0.7029 | 0.7833 | 0.7523 | 0.7143 |
|
| 121 |
+
| 0.2601 | 48.0 | 48000 | 0.7794 | 0.7562 | 0.7815 | 0.7475 | 0.7570 | 0.7562 | 0.7696 | 0.7562 | 0.7549 | 0.8512 | 0.8148 | 0.5874 | 0.7900 | 0.8670 | 0.8846 | 0.4448 | 0.7035 | 0.8227 | 0.7065 | 0.7833 | 0.7523 | 0.7088 |
|
| 122 |
+
| 0.2647 | 49.0 | 49000 | 0.7781 | 0.7568 | 0.7818 | 0.7481 | 0.7574 | 0.7568 | 0.7701 | 0.7568 | 0.7553 | 0.8512 | 0.8148 | 0.5874 | 0.7900 | 0.8698 | 0.8846 | 0.4413 | 0.7066 | 0.8227 | 0.7065 | 0.7833 | 0.7523 | 0.7143 |
|
| 123 |
+
| 0.2527 | 50.0 | 50000 | 0.7779 | 0.7572 | 0.7826 | 0.7485 | 0.7579 | 0.7572 | 0.7707 | 0.7572 | 0.7558 | 0.8533 | 0.8148 | 0.5874 | 0.7900 | 0.8698 | 0.8846 | 0.4448 | 0.7066 | 0.8227 | 0.7065 | 0.7833 | 0.7523 | 0.7143 |
|
| 124 |
+
|
| 125 |
+
|
| 126 |
### Framework versions
|
| 127 |
|
| 128 |
- PEFT 0.14.0
|