Bojun-Feng
/

DeepSeek-R1-Distill-Llama-8B-GGUF-llamafile

Inference Endpoints

Model card Files Files and versions Community

DeepSeek-R1-Distill-Llama-8B-GGUF-llamafile

1 contributor

History: 10 commits

Bojun-Feng's picture

Upload DeepSeek-R1-Distill-Llama-8B-Q8_0.llamafile with huggingface_hub

9ac485a verified 17 days ago

.gitattributes

2.17 kB

Upload DeepSeek-R1-Distill-Llama-8B-Q8_0.llamafile with huggingface_hub 17 days ago
DeepSeek-R1-Distill-Llama-8B-F16.llamafile

16.1 GB
LFS

Upload DeepSeek-R1-Distill-Llama-8B-F16.llamafile with huggingface_hub 17 days ago
DeepSeek-R1-Distill-Llama-8B-Q2_K.llamafile

3.19 GB
LFS

Upload DeepSeek-R1-Distill-Llama-8B-Q2_K.llamafile with huggingface_hub 17 days ago
DeepSeek-R1-Distill-Llama-8B-Q2_K_L.llamafile

3.32 GB
LFS

Upload DeepSeek-R1-Distill-Llama-8B-Q2_K_L.llamafile with huggingface_hub 17 days ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_M.llamafile

4.03 GB
LFS

Upload DeepSeek-R1-Distill-Llama-8B-Q3_K_M.llamafile with huggingface_hub 17 days ago
DeepSeek-R1-Distill-Llama-8B-Q4_K_M.llamafile

4.94 GB
LFS

Upload DeepSeek-R1-Distill-Llama-8B-Q4_K_M.llamafile with huggingface_hub 17 days ago
DeepSeek-R1-Distill-Llama-8B-Q5_K_M.llamafile

5.75 GB
LFS

Upload DeepSeek-R1-Distill-Llama-8B-Q5_K_M.llamafile with huggingface_hub 17 days ago
DeepSeek-R1-Distill-Llama-8B-Q6_K.llamafile

6.61 GB
LFS

Upload DeepSeek-R1-Distill-Llama-8B-Q6_K.llamafile with huggingface_hub 17 days ago
DeepSeek-R1-Distill-Llama-8B-Q8_0.llamafile

8.56 GB
LFS

Upload DeepSeek-R1-Distill-Llama-8B-Q8_0.llamafile with huggingface_hub 17 days ago
README.md

28.5 kB

Upload README.md with huggingface_hub 17 days ago