Update README.md
Browse files
README.md
CHANGED
@@ -17,13 +17,13 @@ tags: []
|
|
17 |
|
18 |
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
|
19 |
|
20 |
-
- **Developed by:**
|
21 |
- **Funded by [optional]:** [More Information Needed]
|
22 |
- **Shared by [optional]:** [More Information Needed]
|
23 |
-
- **Model type:**
|
24 |
- **Language(s) (NLP):** [More Information Needed]
|
25 |
- **License:** [More Information Needed]
|
26 |
-
- **Finetuned from model [optional]:**
|
27 |
|
28 |
### Model Sources [optional]
|
29 |
|
@@ -102,13 +102,16 @@ Use the code below to get started with the model.
|
|
102 |
|
103 |
## Evaluation
|
104 |
|
105 |
-
|
|
|
|
|
|
|
106 |
|
107 |
### Testing Data, Factors & Metrics
|
108 |
|
109 |
#### Testing Data
|
110 |
|
111 |
-
|
112 |
|
113 |
[More Information Needed]
|
114 |
|
|
|
17 |
|
18 |
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
|
19 |
|
20 |
+
- **Developed by:** Chintan Shah
|
21 |
- **Funded by [optional]:** [More Information Needed]
|
22 |
- **Shared by [optional]:** [More Information Needed]
|
23 |
+
- **Model type:** meta-llama/Llama-3.2-1B-Instruct
|
24 |
- **Language(s) (NLP):** [More Information Needed]
|
25 |
- **License:** [More Information Needed]
|
26 |
+
- **Finetuned from model [optional]:** meta-llama/Llama-3.2-1B-Instruct
|
27 |
|
28 |
### Model Sources [optional]
|
29 |
|
|
|
102 |
|
103 |
## Evaluation
|
104 |
|
105 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
106 |
+
|---------|------:|------|-----:|--------|---|-----:|---|-----:|
|
107 |
+
|hellaswag| 1|none | 0|acc |↑ |0.4408|± |0.0050|
|
108 |
+
| | |none | 0|acc_norm|↑ |0.5922|± |0.0049|
|
109 |
|
110 |
### Testing Data, Factors & Metrics
|
111 |
|
112 |
#### Testing Data
|
113 |
|
114 |
+
https://github.com/EleutherAI/lm-evaluation-harnes
|
115 |
|
116 |
[More Information Needed]
|
117 |
|