Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
gemma-2-2b-it-GGUF
like
13
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
gemma-2-2b-it-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
7014b1d6e09be24d30b8f1b2f4022537a201c18a177685712c460ab7b69027f0
c001772
verified
7 months ago
.gitattributes
Safe
2.57 kB
7014b1d6e09be24d30b8f1b2f4022537a201c18a177685712c460ab7b69027f0
7 months ago
README.md
Safe
2.9 kB
1575aed80932503062d63c97db7b8c508fec157caeb9510d12fba16205552eb9
7 months ago
gemma-2-2b-it-GGUF_imatrix.dat
Safe
2.38 MB
LFS
1575aed80932503062d63c97db7b8c508fec157caeb9510d12fba16205552eb9
7 months ago
gemma-2-2b-it.IQ1_M.gguf
Safe
874 MB
LFS
1575aed80932503062d63c97db7b8c508fec157caeb9510d12fba16205552eb9
7 months ago
gemma-2-2b-it.IQ1_S.gguf
Safe
832 MB
LFS
1575aed80932503062d63c97db7b8c508fec157caeb9510d12fba16205552eb9
7 months ago
gemma-2-2b-it.IQ2_XS.gguf
Safe
1 GB
LFS
cb17e85d5ab528a85293a20eedcdcc76dcb576a100ef23d080ac257c6e23197e
7 months ago
gemma-2-2b-it.IQ3_XS.gguf
Safe
1.31 GB
LFS
00930c810dae5ee21d800001c8eb54d596e44b44c209ac4bd2555816d6563657
7 months ago
gemma-2-2b-it.IQ4_XS.gguf
Safe
1.57 GB
LFS
5c5d3d9826daea4f735396576486dcd2d3a51ccb9fee44374656729c87722a78
7 months ago
gemma-2-2b-it.Q2_K.gguf
Safe
1.23 GB
LFS
6f35c4732f45b9171ca358d94bcc86339be441d7e69b591b9976d9c45caaf2e6
7 months ago
gemma-2-2b-it.Q3_K_L.gguf
Safe
1.55 GB
LFS
a67683eece004931bf45bba27ca1e8fc6947029070155e9924bfaf1494fb09c8
7 months ago
gemma-2-2b-it.Q3_K_M.gguf
Safe
1.46 GB
LFS
1f894e5e2276fee462f3da54dd44ffc789bda5d8ca578813f57532d93a914af8
7 months ago
gemma-2-2b-it.Q3_K_S.gguf
Safe
1.36 GB
LFS
e2f6ddbd3ea40b62d4906898b7f98da97be238fe914f41255dc114e2dd19b66b
7 months ago
gemma-2-2b-it.Q4_K_M.gguf
Safe
1.71 GB
LFS
db4793720fc115fbd12b222a721bd8858f2bc82066ed0362ae230ee5e550222f
7 months ago
gemma-2-2b-it.Q4_K_S.gguf
Safe
1.64 GB
LFS
511e6e3ce16bfd58929a106dc5c332c3939c3e9c20f095510de0240496aa0ef0
7 months ago
gemma-2-2b-it.Q5_K_M.gguf
Safe
1.92 GB
LFS
4dcdbcba887dc20544b7d0302992b42bf8622ef0a52aba2b6722712e6b41a719
7 months ago
gemma-2-2b-it.Q5_K_S.gguf
Safe
1.88 GB
LFS
7014b1d6e09be24d30b8f1b2f4022537a201c18a177685712c460ab7b69027f0
7 months ago
gemma-2-2b-it.Q6_K.gguf
Safe
2.15 GB
LFS
48301450a17e467b02d12a71fdd811af6b6802e7c744bc444a427caf81bfab6c
7 months ago
gemma-2-2b-it.Q8_0.gguf
Safe
2.78 GB
LFS
2db7936bd367b61ceedce20f6ac5c574296be209789d4d974afae75a588e6ccb
7 months ago
gemma-2-2b-it.fp16.gguf
Safe
5.24 GB
LFS
a584e1c0177f01d08a02efb2d8ab02ee0fdfe6e0e1a4166ebdb0f4c87b5d9487
7 months ago
