Upload folder using huggingface_hub
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ base_model:
|
|
10 |
- swiss-ai/Apertus-70B-Instruct-2509
|
11 |
---
|
12 |
|
13 |
-
This tiny model is for debugging. It is randomly initialized with the config adapted from [swiss-ai/Apertus-70B-Instruct-2509](https://huggingface.co/swiss-ai/Apertus-70B-Instruct-2509).
|
14 |
|
15 |
### Example usage:
|
16 |
|
@@ -41,9 +41,7 @@ tokenized_chat = tokenizer.apply_chat_template(
|
|
41 |
tokenize=True,
|
42 |
add_generation_prompt=True,
|
43 |
return_tensors="pt",
|
44 |
-
thinking_budget=64 # control the thinking budget
|
45 |
)
|
46 |
-
|
47 |
outputs = model.generate(tokenized_chat.to(model.device), max_new_tokens=128)
|
48 |
output_text = tokenizer.decode(outputs[0])
|
49 |
print(output_text)
|
|
|
10 |
- swiss-ai/Apertus-70B-Instruct-2509
|
11 |
---
|
12 |
|
13 |
+
This tiny model is indented for debugging. It is randomly initialized with the config adapted from [swiss-ai/Apertus-70B-Instruct-2509](https://huggingface.co/swiss-ai/Apertus-70B-Instruct-2509).
|
14 |
|
15 |
### Example usage:
|
16 |
|
|
|
41 |
tokenize=True,
|
42 |
add_generation_prompt=True,
|
43 |
return_tensors="pt",
|
|
|
44 |
)
|
|
|
45 |
outputs = model.generate(tokenized_chat.to(model.device), max_new_tokens=128)
|
46 |
output_text = tokenizer.decode(outputs[0])
|
47 |
print(output_text)
|