|
|
--- |
|
|
datasets: |
|
|
- Delta-Vector/Ursa-Erebus-16K |
|
|
- Delta-Vector/Ursa-Books-Light-Novels-V1 |
|
|
- NewEden/Orion-LIT |
|
|
- Delta-Vector/Ursa-Asstr-V2-18k |
|
|
- Delta-Vector/Ursa-Books-V2 |
|
|
- Delta-Vector/Ursa-Scribblehub-7k |
|
|
- Delta-Vector/Ursa-Orion-EA-Comp-Filtered |
|
|
- Delta-Vector/Ursa-HoneyFeed |
|
|
- Delta-Vector/Ursa-Falling-through-the-world |
|
|
base_model: |
|
|
- SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml |
|
|
--- |
|
|
Finetuned ontop of SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml with |
|
|
|
|
|
``` |
|
|
- Delta-Vector/Ursa-Erebus-16K |
|
|
- Delta-Vector/Ursa-Books-Light-Novels-V1 |
|
|
- NewEden/Orion-LIT |
|
|
- Delta-Vector/Ursa-Asstr-V2-18k |
|
|
- Delta-Vector/Ursa-Books-V2 |
|
|
- Delta-Vector/Ursa-Scribblehub-7k |
|
|
- Delta-Vector/Ursa-Orion-EA-Comp-Filtered |
|
|
- Delta-Vector/Ursa-HoneyFeed |
|
|
- Delta-Vector/Ursa-Falling-through-the-world |
|
|
``` |
|
|
roughly 700M tokens worth of Text Completion. |
|
|
|
|
|
I would recc the downstream instruct and future RP/Adventure/etc finetunes ontop of the said Instruct tune. |
|
|
|
|
|
wandb: https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-tilsti5r/v0/files/axolotl_config__jn5bmx1.yml |
|
|
|
|
|
|
|
|
exl3: (thanks lucy): https://huggingface.co/Delta-Vector/Sol-Reaver-15B-Pretrain-exl3 |
|
|
|
|
|
Support me on Ko-Fi: https://ko-fi.com/deltavector |
