featherless-ai-quants
/

upstage-SOLAR-10.7B-Instruct-v1.0-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

upstage-SOLAR-10.7B-Instruct-v1.0-GGUF

1 contributor

History: 2 commits

m8than's picture

Upload folder using huggingface_hub

fa11b43 verified 4 months ago

.gitattributes

2.47 kB

Upload folder using huggingface_hub 4 months ago
README.md

3.38 kB

Upload folder using huggingface_hub 4 months ago
featherless-quants.png

1.61 MB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-IQ4_XS.gguf
5.83 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q2_K.gguf
4 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q3_K_L.gguf
5.65 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q3_K_M.gguf
5.2 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q3_K_S.gguf
4.66 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q4_K_M.gguf
6.46 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q4_K_S.gguf
6.12 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q5_K_M.gguf
7.6 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q5_K_S.gguf
7.4 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q6_K.gguf
8.81 GB
LFS

Upload folder using huggingface_hub 4 months ago
upstage-SOLAR-10.7B-Instruct-v1.0-Q8_0.gguf
11.4 GB
LFS

Upload folder using huggingface_hub 4 months ago