Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
SmolLM2-1.7B-Instruct-16k-GGUF
like
1
Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Use this model
refs/pr/1
SmolLM2-1.7B-Instruct-16k-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
4c22d8b4063992c42337bbdace46b9a9f68b33cdf1aaca5bbf93d75d86dea707
0e59151
verified
2 days ago
.gitattributes
1.96 kB
4c22d8b4063992c42337bbdace46b9a9f68b33cdf1aaca5bbf93d75d86dea707
2 days ago
README.md
3.05 kB
4266e2201b0f666db463ea28efcfcd554f5d289409b0eb4fc82a4e4be6fc2203
2 days ago
SmolLM2-1.7B-Instruct-16k-GGUF_imatrix.dat
1.97 MB
LFS
4266e2201b0f666db463ea28efcfcd554f5d289409b0eb4fc82a4e4be6fc2203
2 days ago
SmolLM2-1.7B-Instruct-16k.Q5_K_M.gguf
1.23 GB
LFS
4266e2201b0f666db463ea28efcfcd554f5d289409b0eb4fc82a4e4be6fc2203
2 days ago
SmolLM2-1.7B-Instruct-16k.Q5_K_S.gguf
1.19 GB
LFS
f615b02262953e2dc0bc868061103fbff2dae4c506371af3c34d2c40d0883a8c
2 days ago
SmolLM2-1.7B-Instruct-16k.Q6_K.gguf
1.41 GB
LFS
09aa7bd80ee227e10437977ea23b96ad5685645c7062bc3c634f15372fb40c20
2 days ago
SmolLM2-1.7B-Instruct-16k.Q8_0.gguf
1.82 GB
LFS
4c22d8b4063992c42337bbdace46b9a9f68b33cdf1aaca5bbf93d75d86dea707
2 days ago
SmolLM2-1.7B-Instruct-16k.fp16.gguf
3.42 GB
LFS
dba388947956a31a4806b1dc539097d48b9bb67778e1c9580daa1a8efe46a009
2 days ago
