mesh-ops commited on
Commit
5ce118d
·
verified ·
1 Parent(s): 6e4df58

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +15 -0
  3. gpt-oss-20B-base-MXFP4.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gpt-oss-20B-base-MXFP4.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: mit
5
+ datasets:
6
+ - HuggingFaceFW/fineweb
7
+ base_model: jxm/gpt-oss-20b-base
8
+ library_name: transformers
9
+ tags:
10
+ - llama-cpp
11
+ ---
12
+
13
+ Quantized to MXFP4 using llama.cpp b6150
14
+
15
+ I also gguf-my-repo'd a q6_K on my personal account but it's actually not any better and it's too big. looks like llama.cpp quantization is bad quality for these models except for mxfp4
gpt-oss-20B-base-MXFP4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56c638e1fb07d07e4e498993b700e4cbf23aae1de3af6df33ac55596d7ce14a8
3
+ size 12109567040