chintanshrinath commited on
Commit
87d95b8
·
verified ·
1 Parent(s): e3546cf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -5
README.md CHANGED
@@ -17,13 +17,13 @@ tags: []
17
 
18
  This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
 
20
- - **Developed by:** [More Information Needed]
21
  - **Funded by [optional]:** [More Information Needed]
22
  - **Shared by [optional]:** [More Information Needed]
23
- - **Model type:** [More Information Needed]
24
  - **Language(s) (NLP):** [More Information Needed]
25
  - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
 
28
  ### Model Sources [optional]
29
 
@@ -102,13 +102,16 @@ Use the code below to get started with the model.
102
 
103
  ## Evaluation
104
 
105
- <!-- This section describes the evaluation protocols and provides the results. -->
 
 
 
106
 
107
  ### Testing Data, Factors & Metrics
108
 
109
  #### Testing Data
110
 
111
- <!-- This should link to a Dataset Card if possible. -->
112
 
113
  [More Information Needed]
114
 
 
17
 
18
  This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
19
 
20
+ - **Developed by:** Chintan Shah
21
  - **Funded by [optional]:** [More Information Needed]
22
  - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** meta-llama/Llama-3.2-1B-Instruct
24
  - **Language(s) (NLP):** [More Information Needed]
25
  - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** meta-llama/Llama-3.2-1B-Instruct
27
 
28
  ### Model Sources [optional]
29
 
 
102
 
103
  ## Evaluation
104
 
105
+ | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
106
+ |---------|------:|------|-----:|--------|---|-----:|---|-----:|
107
+ |hellaswag| 1|none | 0|acc |↑ |0.4408|± |0.0050|
108
+ | | |none | 0|acc_norm|↑ |0.5922|± |0.0049|
109
 
110
  ### Testing Data, Factors & Metrics
111
 
112
  #### Testing Data
113
 
114
+ https://github.com/EleutherAI/lm-evaluation-harnes
115
 
116
  [More Information Needed]
117