Hugging Face's logo

TroyDoesAI
/
Mini_Llama-3B-Base

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Model card Files Community
TroyDoesAI commited on
Commit
b04523c
·
verified ·
1 Parent(s): 3c9fa63

Upload 9 files

Browse files
Files changed (2) hide show
  1. config.json +1 -1
  2. model-00001-of-00001.safetensors +1 -1
config.json CHANGED
@@ -10,7 +10,7 @@
10
  "hidden_size": 3072,
11
  "initializer_range": 0.02,
12
  "intermediate_size": 8192,
13
- "max_position_embeddings": 4096,
14
  "model_type": "llama",
15
  "num_attention_heads": 32,
16
  "num_hidden_layers": 32,
 
10
  "hidden_size": 3072,
11
  "initializer_range": 0.02,
12
  "intermediate_size": 8192,
13
+ "max_position_embeddings": 131072,
14
  "model_type": "llama",
15
  "num_attention_heads": 32,
16
  "num_hidden_layers": 32,
model-00001-of-00001.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f4325db170a9ecf747a4ed27f07f0745a6dedc963c0bd40169a9eb923e9e2a36
3
  size 7642192824
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecddd5168c2d7a53590358b2f699bc204fb88060f6e546beabfa88bcf8663aaf
3
  size 7642192824