yuzhounie commited on
Commit
f79a3cb
·
verified ·
1 Parent(s): 19f5e15

Model save

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # gaia_qwen2_7B
17
 
18
- This model is a fine-tuned version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) on an unknown dataset.
19
 
20
  ## Model description
21
 
@@ -40,8 +40,8 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - distributed_type: multi-GPU
42
  - num_devices: 4
43
- - gradient_accumulation_steps: 2
44
- - total_train_batch_size: 8
45
  - total_eval_batch_size: 32
46
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
  - lr_scheduler_type: cosine
 
15
 
16
  # gaia_qwen2_7B
17
 
18
+ This model is a fine-tuned version of [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct) on the None dataset.
19
 
20
  ## Model description
21
 
 
40
  - seed: 42
41
  - distributed_type: multi-GPU
42
  - num_devices: 4
43
+ - gradient_accumulation_steps: 12
44
+ - total_train_batch_size: 48
45
  - total_eval_batch_size: 32
46
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
  - lr_scheduler_type: cosine