experimental 4-bit dynamic quant using unsloth, these model will be used for inference and RoPE fine-tuning.
huggingkot
huggingkot
AI & ML interests
None yet
Recent Activity
new activity
3 days ago
microsoft/Phi-4-multimodal-instruct:HOW TO GET ACCESS TO THIS MODEL?
new activity
28 days ago
microsoft/bitnet-b1.58-2B-4T-gguf:running model in ollama is not supported.
updated
a model
about 1 month ago
huggingkot/Impish_Magic_24B-bnb-4bit
Organizations
None yet
models
77
huggingkot/Impish_Magic_24B-bnb-4bit
24B
•
Updated
•
1
huggingkot/aya-expanse-8b-bnb-4bit
8B
•
Updated
•
8
huggingkot/aya-23-35B-bnb-4bit
Updated
•
2
huggingkot/Mistral-Nemo-Instruct-2407-bnb-4bit
12B
•
Updated
•
6
huggingkot/Impish_Nemo_12B-q4f16_1-MLC
Text Generation
•
Updated
•
2
•
1
huggingkot/Verina-GPT-SoVITS-v2ProPlus-DPO-EN-JA-ZH
Text-to-Speech
•
Updated
•
1
huggingkot/Lily-Qwen1.5-0.5B-q4f16_1-MLC
Text Generation
•
Updated
huggingkot/Lily-Qwen1.5-0.5B-bnb-4bit
0.3B
•
Updated
•
1
huggingkot/Nano_Imp_1B-bnb-4bit
0.8B
•
Updated
huggingkot/Nano_Imp_1B-q4f16_1-MLC
Text Generation
•
Updated
•
1
•
1
datasets
0
None public yet