Hugging Face's logo

csujeong
/
Gemma-7B-Finetuning-JCS-Ko-Ins

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
1
csujeong commited on
Commit
8d9c5f2
·
verified ·
1 Parent(s): 38fbf06

Training in progress, step 20

Browse files
Files changed (6) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Feb26_14-06-57_e7cca09e096a/events.out.tfevents.1708956653.e7cca09e096a.365.0 +2 -2
  3. wandb/debug-internal.log +49 -0
  4. wandb/run-20240226_141107-8c2rkhry/files/config.yaml +16 -0
  5. wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json +1 -1
  6. wandb/run-20240226_141107-8c2rkhry/logs/debug-internal.log +49 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:08941f9455edc9425bc63073ce77f37a8770a6e77342a6cb5e3043d05c39d2b5
3
  size 201888736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e9b4db604031fd3be89e2a286dec27d7b9644487f60bf4b7dd83b429e140a94
3
  size 201888736
runs/Feb26_14-06-57_e7cca09e096a/events.out.tfevents.1708956653.e7cca09e096a.365.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0a3669ff746af745843c5349119b948eebec7ec7390c395f90951cc0c97383b3
3
- size 5373
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdf9ae5eb8c0f50d096b16d6c771f109ae122e5526bfe80e8410c4a2a6ebe623
3
+ size 5580
wandb/debug-internal.log CHANGED
@@ -113,3 +113,52 @@
113
  2024-02-26 14:13:29,119 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
114
  2024-02-26 14:13:34,120 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
115
  2024-02-26 14:13:39,121 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
113
  2024-02-26 14:13:29,119 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
114
  2024-02-26 14:13:34,120 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
115
  2024-02-26 14:13:39,121 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
116
+ 2024-02-26 14:13:40,852 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
117
+ 2024-02-26 14:13:40,976 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
118
+ 2024-02-26 14:13:40,977 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
119
+ 2024-02-26 14:13:41,017 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
120
+ 2024-02-26 14:13:45,110 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
121
+ 2024-02-26 14:13:45,855 INFO Thread-12 :3960 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko-Ins/wandb/run-20240226_141107-8c2rkhry/files/config.yaml
122
+ 2024-02-26 14:13:50,227 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
123
+ 2024-02-26 14:13:55,228 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
124
+ 2024-02-26 14:13:55,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
125
+ 2024-02-26 14:13:55,977 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
126
+ 2024-02-26 14:13:56,010 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
127
+ 2024-02-26 14:14:01,011 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
128
+ 2024-02-26 14:14:06,012 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
129
+ 2024-02-26 14:14:10,853 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
130
+ 2024-02-26 14:14:10,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
131
+ 2024-02-26 14:14:10,977 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
132
+ 2024-02-26 14:14:11,017 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
133
+ 2024-02-26 14:14:11,036 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
134
+ 2024-02-26 14:14:16,037 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
135
+ 2024-02-26 14:14:21,038 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
136
+ 2024-02-26 14:14:25,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
137
+ 2024-02-26 14:14:25,978 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
138
+ 2024-02-26 14:14:26,018 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
139
+ 2024-02-26 14:14:26,059 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
140
+ 2024-02-26 14:14:31,060 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
141
+ 2024-02-26 14:14:36,061 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
142
+ 2024-02-26 14:14:40,854 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
143
+ 2024-02-26 14:14:40,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
144
+ 2024-02-26 14:14:40,978 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
145
+ 2024-02-26 14:14:41,018 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
146
+ 2024-02-26 14:14:41,103 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
147
+ 2024-02-26 14:14:46,104 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
148
+ 2024-02-26 14:14:51,105 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
149
+ 2024-02-26 14:14:55,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
150
+ 2024-02-26 14:14:55,978 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
151
+ 2024-02-26 14:14:56,018 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
152
+ 2024-02-26 14:14:57,074 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
153
+ 2024-02-26 14:14:57,534 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: partial_history
154
+ 2024-02-26 14:14:57,535 DEBUG SenderThread:3960 [sender.py:send():382] send: history
155
+ 2024-02-26 14:14:57,536 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: summary_record
156
+ 2024-02-26 14:14:57,553 INFO SenderThread:3960 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
157
+ 2024-02-26 14:14:58,028 INFO Thread-12 :3960 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko-Ins/wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json
158
+ 2024-02-26 14:15:02,556 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
159
+ 2024-02-26 14:15:07,557 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
160
+ 2024-02-26 14:15:10,858 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
161
+ 2024-02-26 14:15:10,984 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
162
+ 2024-02-26 14:15:10,986 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
163
+ 2024-02-26 14:15:11,002 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
164
+ 2024-02-26 14:15:13,048 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240226_141107-8c2rkhry/files/config.yaml CHANGED
@@ -56,6 +56,22 @@ _wandb:
56
  - 1: train/global_step
57
  6:
58
  - 3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
59
  vocab_size:
60
  desc: null
61
  value: 256000
 
56
  - 1: train/global_step
57
  6:
58
  - 3
59
+ - 1: train/loss
60
+ 5: 1
61
+ 6:
62
+ - 1
63
+ - 1: train/grad_norm
64
+ 5: 1
65
+ 6:
66
+ - 1
67
+ - 1: train/learning_rate
68
+ 5: 1
69
+ 6:
70
+ - 1
71
+ - 1: train/epoch
72
+ 5: 1
73
+ 6:
74
+ - 1
75
  vocab_size:
76
  desc: null
77
  value: 256000
wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 2.7809, "train/grad_norm": 3.2141225337982178, "train/learning_rate": 0.00019075754196709572, "train/epoch": 0.07, "train/global_step": 10, "_timestamp": 1708956800.6686552, "_runtime": 133.09721326828003, "_step": 0}
 
1
+ {"train/loss": 2.0822, "train/grad_norm": 3.2967498302459717, "train/learning_rate": 0.00015611870653623825, "train/epoch": 0.15, "train/global_step": 20, "_timestamp": 1708956897.533535, "_runtime": 229.9620931148529, "_step": 1}
wandb/run-20240226_141107-8c2rkhry/logs/debug-internal.log CHANGED
@@ -113,3 +113,52 @@
113
  2024-02-26 14:13:29,119 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
114
  2024-02-26 14:13:34,120 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
115
  2024-02-26 14:13:39,121 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
113
  2024-02-26 14:13:29,119 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
114
  2024-02-26 14:13:34,120 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
115
  2024-02-26 14:13:39,121 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
116
+ 2024-02-26 14:13:40,852 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
117
+ 2024-02-26 14:13:40,976 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
118
+ 2024-02-26 14:13:40,977 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
119
+ 2024-02-26 14:13:41,017 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
120
+ 2024-02-26 14:13:45,110 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
121
+ 2024-02-26 14:13:45,855 INFO Thread-12 :3960 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko-Ins/wandb/run-20240226_141107-8c2rkhry/files/config.yaml
122
+ 2024-02-26 14:13:50,227 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
123
+ 2024-02-26 14:13:55,228 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
124
+ 2024-02-26 14:13:55,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
125
+ 2024-02-26 14:13:55,977 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
126
+ 2024-02-26 14:13:56,010 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
127
+ 2024-02-26 14:14:01,011 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
128
+ 2024-02-26 14:14:06,012 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
129
+ 2024-02-26 14:14:10,853 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
130
+ 2024-02-26 14:14:10,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
131
+ 2024-02-26 14:14:10,977 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
132
+ 2024-02-26 14:14:11,017 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
133
+ 2024-02-26 14:14:11,036 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
134
+ 2024-02-26 14:14:16,037 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
135
+ 2024-02-26 14:14:21,038 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
136
+ 2024-02-26 14:14:25,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
137
+ 2024-02-26 14:14:25,978 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
138
+ 2024-02-26 14:14:26,018 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
139
+ 2024-02-26 14:14:26,059 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
140
+ 2024-02-26 14:14:31,060 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
141
+ 2024-02-26 14:14:36,061 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
142
+ 2024-02-26 14:14:40,854 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
143
+ 2024-02-26 14:14:40,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
144
+ 2024-02-26 14:14:40,978 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
145
+ 2024-02-26 14:14:41,018 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
146
+ 2024-02-26 14:14:41,103 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
147
+ 2024-02-26 14:14:46,104 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
148
+ 2024-02-26 14:14:51,105 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
149
+ 2024-02-26 14:14:55,977 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
150
+ 2024-02-26 14:14:55,978 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
151
+ 2024-02-26 14:14:56,018 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
152
+ 2024-02-26 14:14:57,074 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
153
+ 2024-02-26 14:14:57,534 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: partial_history
154
+ 2024-02-26 14:14:57,535 DEBUG SenderThread:3960 [sender.py:send():382] send: history
155
+ 2024-02-26 14:14:57,536 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: summary_record
156
+ 2024-02-26 14:14:57,553 INFO SenderThread:3960 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
157
+ 2024-02-26 14:14:58,028 INFO Thread-12 :3960 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/gdrive/MyDrive/LLM/Gemma-7B-Finetuning-JCS-Ko-Ins/wandb/run-20240226_141107-8c2rkhry/files/wandb-summary.json
158
+ 2024-02-26 14:15:02,556 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
159
+ 2024-02-26 14:15:07,557 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report
160
+ 2024-02-26 14:15:10,858 DEBUG SenderThread:3960 [sender.py:send():382] send: stats
161
+ 2024-02-26 14:15:10,984 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: stop_status
162
+ 2024-02-26 14:15:10,986 DEBUG SenderThread:3960 [sender.py:send_request():409] send_request: stop_status
163
+ 2024-02-26 14:15:11,002 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: internal_messages
164
+ 2024-02-26 14:15:13,048 DEBUG HandlerThread:3960 [handler.py:handle_request():146] handle_request: status_report