A finetuning experiment on llama3 8b it with selected 5k examples from argilla dpo 7k
- Downloads last month
- 2
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
Model tree for eren23/DPOMixLLama-3-8B-lora
Base model
meta-llama/Meta-Llama-3-8B-Instruct