rahuldshetty/tinyllama-python-gguf
Quantized GGUF model files for tinyllama-python.
- Base model: unsloth/tinyllama-bnb-4bit
- Dataset: iamtarun/python_code_instructions_18k_alpaca
- Training Script: unslothai: Alpaca + TinyLlama + RoPE Scaling full example.ipynb
| Name | Quant method | Size |
|---|---|---|
| tinyllama-python-unsloth.Q2_K.gguf | fp16 | 432 MB |
Prompt Format
### Instruction:
{instruction}
### Response:
Example
### Instruction:
Write a function to find cube of a number.
### Response:
- Downloads last month
- 13
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.