InferenceLab
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -32,12 +32,6 @@ This model is a domain-adapted version of LLaMA 3.2 3B Instruct. It has been fin
|
|
32 |
- **License:** Apache 2.0
|
33 |
- **Finetuned from model:** meta-llama/Llama-3.2-3B-Instruct
|
34 |
|
35 |
-
### Model Sources
|
36 |
-
|
37 |
-
- **Repository:** [More Information Needed]
|
38 |
-
- **Paper [optional]:** [More Information Needed]
|
39 |
-
- **Demo [optional]:** [More Information Needed]
|
40 |
-
|
41 |
## Uses
|
42 |
|
43 |
### Direct Use
|
@@ -96,14 +90,11 @@ Tokenization using LLaMA tokenizer with special medical instruction formatting.
|
|
96 |
#### Training Hyperparameters
|
97 |
|
98 |
* **Training regime:** bf16 mixed precision
|
99 |
-
* **
|
100 |
-
* **Batch size:** 64
|
101 |
-
* **Learning rate:** 2e-5
|
102 |
|
103 |
#### Speeds, Sizes, Times
|
104 |
|
105 |
* **Training time:** \~12 hours on 4×A100 GPUs
|
106 |
-
* **Final model size:** \~3.1B parameters
|
107 |
|
108 |
## Evaluation
|
109 |
|
@@ -165,23 +156,6 @@ Explainability tools like LLaMA-MedLens (if available) are suggested to interpre
|
|
165 |
* Unsloth
|
166 |
* PyTorch 2.1
|
167 |
|
168 |
-
## Citation
|
169 |
-
|
170 |
-
**BibTeX:**
|
171 |
-
|
172 |
-
```bibtex
|
173 |
-
@misc{medillama_2025,
|
174 |
-
author = {InferenceLab},
|
175 |
-
title = {MediLlama-3.2: A Medical Chatbot Fine-Tuned from LLaMA 3.2},
|
176 |
-
year = {2025},
|
177 |
-
publisher = {HuggingFace},
|
178 |
-
howpublished = {\url{https://huggingface.co/InferenceLab/MediLlama-3.2}},
|
179 |
-
}
|
180 |
-
```
|
181 |
-
|
182 |
-
**APA:**
|
183 |
-
|
184 |
-
InferenceLab. (2025). *MediLlama-3.2: A Medical Chatbot Fine-Tuned from LLaMA 3.2*. Hugging Face. [https://huggingface.co/InferenceLab/MediLlama-3.2](https://huggingface.co/InferenceLab/MediLlama-3.2)
|
185 |
|
186 |
## Glossary
|
187 |
|
@@ -197,8 +171,6 @@ For collaborations, deployment help, or fine-tuning extensions, please contact t
|
|
197 |
|
198 |
* InferenceLab Team
|
199 |
|
200 |
-
## Model Card Contact
|
201 |
|
202 |
-
* [[email protected]](mailto:[email protected])
|
203 |
|
204 |
|
|
|
32 |
- **License:** Apache 2.0
|
33 |
- **Finetuned from model:** meta-llama/Llama-3.2-3B-Instruct
|
34 |
|
|
|
|
|
|
|
|
|
|
|
|
|
35 |
## Uses
|
36 |
|
37 |
### Direct Use
|
|
|
90 |
#### Training Hyperparameters
|
91 |
|
92 |
* **Training regime:** bf16 mixed precision
|
93 |
+
* **Learning rate:** 1e-5
|
|
|
|
|
94 |
|
95 |
#### Speeds, Sizes, Times
|
96 |
|
97 |
* **Training time:** \~12 hours on 4×A100 GPUs
|
|
|
98 |
|
99 |
## Evaluation
|
100 |
|
|
|
156 |
* Unsloth
|
157 |
* PyTorch 2.1
|
158 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
159 |
|
160 |
## Glossary
|
161 |
|
|
|
171 |
|
172 |
* InferenceLab Team
|
173 |
|
|
|
174 |
|
|
|
175 |
|
176 |
|