Update README.md
Browse files
README.md
CHANGED
|
@@ -27,10 +27,9 @@ model-index:
|
|
| 27 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 28 |
should probably proofread and complete it, then remove this comment. -->
|
| 29 |
|
| 30 |
-
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/loubnabnl/huggingface/runs/bxdnlpsh)
|
| 31 |
# smollm2-135M-8k-lc100k-mix1-ep2
|
| 32 |
|
| 33 |
-
This model is a fine-tuned version of [HuggingFaceTB/135M-
|
| 34 |
It achieves the following results on the evaluation set:
|
| 35 |
- Loss: 1.8390
|
| 36 |
|
|
|
|
| 27 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 28 |
should probably proofread and complete it, then remove this comment. -->
|
| 29 |
|
|
|
|
| 30 |
# smollm2-135M-8k-lc100k-mix1-ep2
|
| 31 |
|
| 32 |
+
This model is a fine-tuned version of [HuggingFaceTB/SmoLLM2-135M](https://huggingface.co/HuggingFaceTB/SmolLM2-135M) on [Smol-SmolTalk](https://huggingface.co/datasets/HuggingFaceTB/smol-smoltalk) (the HuggingFaceTB/magpie-ultra-v1.0-top-300K-short-H4, the HuggingFaceTB/OpenHermes-2.5-H4-200k, the HuggingFaceTB/ifeval-like-data-36k-H4, the HuggingFaceTB/everyday-conversations-llama3.1-2k, the HuggingFaceTB/self-oss-instruct-sc2-H4, the HuggingFaceTB/summarization-data-10k-H4, the HuggingFaceTB/smollm-v2-summarization, the HuggingFaceTB/smollm-v2-rewriting-50k-H4, the HuggingFaceTB/explore-instruct-rewrite-H4 and the HuggingFaceTB/LongAlign-16k-ctx-english-H4 datasets).
|
| 33 |
It achieves the following results on the evaluation set:
|
| 34 |
- Loss: 1.8390
|
| 35 |
|