Model Card for Model ID

329X DPO'd Model. Finetuned off meta-llama/Llama-3.2-1B. Trained for 1 epoch, learning rate=2e-4, batch_size=1.

  • PEFT 0.10.0
Downloads last month
5
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no pipeline_tag.

Model tree for swulee/cs329x-llama-3.2-1B-dpo

Adapter
(265)
this model