Just a q8_0 and q4_0 version. If you need versions with other quantization parameters, please let me know

Downloads last month
794
GGUF
Model size
34.4B params
Architecture
llama

4-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The HF Inference API does not support model that require custom code execution.

Datasets used to train TriadParty/deepsex-34b-gguf