This model is the DeciLM-6b-Instruct model, trained specifically for medicine
Galen uses the
### User: {prompt}
### Response:
or
{prompt}
Prompt templates
Galen Training Recipe:
- target_modules = ["q_proj", "v_proj", "gate_proj", "down_proj", "up_proj", "k_proj", "o_proj"]
- Learning Rate: 4e-4
- LR Scheduler: constant
- 250 Steps
T3: 1 Hour
- Downloads last month
- 106
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The HF Inference API does not support model that require custom code execution.