TheStageAI
/

Elastic-Mistral-7B-Instruct-v0.3

Text Generation

text2text-generation

Model card Files Files and versions Community

psynote123 commited on Apr 24

Commit

75fcdba

·

verified ·

1 Parent(s): d1e157a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -59,7 +59,7 @@ model = AutoModelForCausalLM.from_pretrained(
     token=hf_token,
     torch_dtype=torch.bfloat16,
     attn_implementation="sdpa",
-    mode='s'
 ).to(device)
 model.generation_config.pad_token_id = tokenizer.eos_token_id

     token=hf_token,
     torch_dtype=torch.bfloat16,
     attn_implementation="sdpa",
+    mode='S'
 ).to(device)
 model.generation_config.pad_token_id = tokenizer.eos_token_id