Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32-i1-GGUF
like
0
Transformers
GGUF
English
mergekit
mixture of experts
Mixture of Experts
4x8B
float32
32 bit enhanced
LLama MOE
Merge
Inference Endpoints
imatrix
conversational
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32-i1-GGUF
1 contributor
History:
28 commits
mradermacher
auto-patch README.md
570479c
verified
5 days ago
.gitattributes
3.69 kB
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ1_M.gguf
5.94 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ1_S.gguf
5.42 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ2_M.gguf
8.44 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ2_S.gguf
7.75 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ2_XS.gguf
7.52 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ2_XXS.gguf
6.81 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ3_M.gguf
11.1 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ3_S.gguf
11 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ3_XS.gguf
10.4 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ3_XXS.gguf
9.75 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-IQ4_XS.gguf
13.4 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q2_K.gguf
9.3 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q2_K_S.gguf
8.71 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q3_K_L.gguf
13 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q3_K_M.gguf
12.1 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q3_K_S.gguf
10.9 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q4_0.gguf
14.2 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q4_1.gguf
15.7 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q4_K_M.gguf
15.2 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q4_K_S.gguf
14.3 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q5_K_M.gguf
17.7 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q5_K_S.gguf
17.2 GB
LFS
uploaded from marco
5 days ago
L3-Grand-Story-Darkness-MOE-4X8-24.9B-e32.i1-Q6_K.gguf
20.5 GB
LFS
uploaded from marco
5 days ago
README.md
6.52 kB
auto-patch README.md
5 days ago
imatrix.dat
14.2 MB
LFS
uploaded from marco
5 days ago