Hugging Face's logo

kertob
/
content

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files
xet
Metrics Community
kertob commited on
Commit
7755b6e
·
verified ·
1 Parent(s): 03289ab

Training in progress, step 30

Browse files
Files changed (8) hide show
  1. adapter_model.safetensors +1 -1
  2. runs/Mar08_13-01-52_4997a2709b0f/events.out.tfevents.1709902913.4997a2709b0f.24536.0 +2 -2
  3. wandb/debug-internal.log +75 -0
  4. wandb/run-20240308_130200-qomx2zsg/files/config.yaml +20 -0
  5. wandb/run-20240308_130200-qomx2zsg/files/output.log +1 -0
  6. wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json +1 -1
  7. wandb/run-20240308_130200-qomx2zsg/logs/debug-internal.log +75 -0
  8. wandb/run-20240308_130200-qomx2zsg/run-qomx2zsg.wandb +0 -0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1ac30dac5d662aba0e9c2c433f9d802bdab0b896f0320f850174b591f34d306a
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4f90b892e27c815410c1e9979c52b4bb573e4c327f048e659b48a0086f90ff4
3
  size 261131840
runs/Mar08_13-01-52_4997a2709b0f/events.out.tfevents.1709902913.4997a2709b0f.24536.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:53bc2e3988fc85a013ae1436a5c28d700c2e2005b968ce245182f91766c75a4b
3
- size 6145
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69356fc09b33ab3af35e4464d52c2e410565fdac3caa1aea79482a8d969798e5
3
+ size 6700
wandb/debug-internal.log CHANGED
@@ -158,3 +158,78 @@
158
  2024-03-08 13:05:52,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
159
  2024-03-08 13:05:52,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
160
  2024-03-08 13:05:54,647 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
158
  2024-03-08 13:05:52,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
159
  2024-03-08 13:05:52,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
160
  2024-03-08 13:05:54,647 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
161
+ 2024-03-08 13:05:59,648 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
162
+ 2024-03-08 13:06:04,648 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
163
+ 2024-03-08 13:06:06,590 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
164
+ 2024-03-08 13:06:07,431 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
165
+ 2024-03-08 13:06:07,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
166
+ 2024-03-08 13:06:07,472 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
167
+ 2024-03-08 13:06:10,626 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
168
+ 2024-03-08 13:06:15,627 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
169
+ 2024-03-08 13:06:20,628 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
170
+ 2024-03-08 13:06:22,431 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
171
+ 2024-03-08 13:06:22,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
172
+ 2024-03-08 13:06:22,472 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
173
+ 2024-03-08 13:06:25,728 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
174
+ 2024-03-08 13:06:30,729 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
175
+ 2024-03-08 13:06:35,730 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
176
+ 2024-03-08 13:06:36,590 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
177
+ 2024-03-08 13:06:37,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
178
+ 2024-03-08 13:06:37,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
179
+ 2024-03-08 13:06:37,472 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
180
+ 2024-03-08 13:06:41,647 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
181
+ 2024-03-08 13:06:46,648 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
182
+ 2024-03-08 13:06:51,649 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
183
+ 2024-03-08 13:06:52,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
184
+ 2024-03-08 13:06:52,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
185
+ 2024-03-08 13:06:52,473 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
186
+ 2024-03-08 13:06:57,635 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
187
+ 2024-03-08 13:07:02,636 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
188
+ 2024-03-08 13:07:06,591 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
189
+ 2024-03-08 13:07:07,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
190
+ 2024-03-08 13:07:07,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
191
+ 2024-03-08 13:07:07,473 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
192
+ 2024-03-08 13:07:07,682 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
193
+ 2024-03-08 13:07:12,683 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
194
+ 2024-03-08 13:07:17,684 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
195
+ 2024-03-08 13:07:22,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
196
+ 2024-03-08 13:07:22,433 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
197
+ 2024-03-08 13:07:22,473 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
198
+ 2024-03-08 13:07:23,648 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
199
+ 2024-03-08 13:07:28,649 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
200
+ 2024-03-08 13:07:33,635 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: partial_history
201
+ 2024-03-08 13:07:33,637 DEBUG SenderThread:25394 [sender.py:send():378] send: history
202
+ 2024-03-08 13:07:33,637 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: summary_record
203
+ 2024-03-08 13:07:33,638 INFO SenderThread:25394 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
204
+ 2024-03-08 13:07:33,676 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
205
+ 2024-03-08 13:07:34,458 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json
206
+ 2024-03-08 13:07:36,459 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/output.log
207
+ 2024-03-08 13:07:36,592 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
208
+ 2024-03-08 13:07:37,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
209
+ 2024-03-08 13:07:37,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
210
+ 2024-03-08 13:07:37,434 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
211
+ 2024-03-08 13:07:38,284 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: partial_history
212
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
213
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
214
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
215
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
216
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
217
+ 2024-03-08 13:07:38,287 DEBUG SenderThread:25394 [sender.py:send():378] send: history
218
+ 2024-03-08 13:07:38,287 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: summary_record
219
+ 2024-03-08 13:07:38,287 INFO SenderThread:25394 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
220
+ 2024-03-08 13:07:38,460 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json
221
+ 2024-03-08 13:07:39,288 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
222
+ 2024-03-08 13:07:44,293 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
223
+ 2024-03-08 13:07:45,462 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/config.yaml
224
+ 2024-03-08 13:07:49,581 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
225
+ 2024-03-08 13:07:52,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
226
+ 2024-03-08 13:07:52,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
227
+ 2024-03-08 13:07:52,434 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
228
+ 2024-03-08 13:07:54,708 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
229
+ 2024-03-08 13:07:59,710 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
230
+ 2024-03-08 13:08:04,711 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
231
+ 2024-03-08 13:08:06,593 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
232
+ 2024-03-08 13:08:07,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
233
+ 2024-03-08 13:08:07,433 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
234
+ 2024-03-08 13:08:07,474 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
235
+ 2024-03-08 13:08:10,623 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_130200-qomx2zsg/files/config.yaml CHANGED
@@ -72,6 +72,26 @@ _wandb:
72
  5: 1
73
  6:
74
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
  vocab_size:
76
  desc: null
77
  value: 65024
 
72
  5: 1
73
  6:
74
  - 1
75
+ - 1: train/train_runtime
76
+ 5: 1
77
+ 6:
78
+ - 1
79
+ - 1: train/train_samples_per_second
80
+ 5: 1
81
+ 6:
82
+ - 1
83
+ - 1: train/train_steps_per_second
84
+ 5: 1
85
+ 6:
86
+ - 1
87
+ - 1: train/total_flos
88
+ 5: 1
89
+ 6:
90
+ - 1
91
+ - 1: train/train_loss
92
+ 5: 1
93
+ 6:
94
+ - 1
95
  vocab_size:
96
  desc: null
97
  value: 65024
wandb/run-20240308_130200-qomx2zsg/files/output.log CHANGED
@@ -1,2 +1,3 @@
1
 
2
  Checkpoint destination directory ./checkpoint-10 already exists and is non-empty. Saving will proceed but saved results may be invalid.
 
 
1
 
2
  Checkpoint destination directory ./checkpoint-10 already exists and is non-empty. Saving will proceed but saved results may be invalid.
3
+ Checkpoint destination directory ./checkpoint-20 already exists and is non-empty. Saving will proceed but saved results may be invalid.
wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.3516, "train/grad_norm": 0.2534314692020416, "train/learning_rate": 2.65795779650105e-05, "train/epoch": 1.6, "train/global_step": 20, "_timestamp": 1709903138.2519133, "_runtime": 217.4652624130249, "_step": 1}
 
1
+ {"train/loss": 0.0099, "train/grad_norm": 0.054070062935352325, "train/learning_rate": 0.0, "train/epoch": 2.4, "train/global_step": 30, "_timestamp": 1709903258.2842968, "_runtime": 337.49764585494995, "_step": 3, "train/train_runtime": 344.3671, "train/train_samples_per_second": 1.394, "train/train_steps_per_second": 0.087, "train/total_flos": 2466763961794560.0, "train/train_loss": 0.8807701396445433}
wandb/run-20240308_130200-qomx2zsg/logs/debug-internal.log CHANGED
@@ -158,3 +158,78 @@
158
  2024-03-08 13:05:52,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
159
  2024-03-08 13:05:52,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
160
  2024-03-08 13:05:54,647 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
158
  2024-03-08 13:05:52,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
159
  2024-03-08 13:05:52,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
160
  2024-03-08 13:05:54,647 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
161
+ 2024-03-08 13:05:59,648 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
162
+ 2024-03-08 13:06:04,648 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
163
+ 2024-03-08 13:06:06,590 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
164
+ 2024-03-08 13:06:07,431 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
165
+ 2024-03-08 13:06:07,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
166
+ 2024-03-08 13:06:07,472 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
167
+ 2024-03-08 13:06:10,626 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
168
+ 2024-03-08 13:06:15,627 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
169
+ 2024-03-08 13:06:20,628 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
170
+ 2024-03-08 13:06:22,431 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
171
+ 2024-03-08 13:06:22,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
172
+ 2024-03-08 13:06:22,472 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
173
+ 2024-03-08 13:06:25,728 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
174
+ 2024-03-08 13:06:30,729 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
175
+ 2024-03-08 13:06:35,730 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
176
+ 2024-03-08 13:06:36,590 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
177
+ 2024-03-08 13:06:37,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
178
+ 2024-03-08 13:06:37,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
179
+ 2024-03-08 13:06:37,472 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
180
+ 2024-03-08 13:06:41,647 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
181
+ 2024-03-08 13:06:46,648 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
182
+ 2024-03-08 13:06:51,649 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
183
+ 2024-03-08 13:06:52,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
184
+ 2024-03-08 13:06:52,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
185
+ 2024-03-08 13:06:52,473 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
186
+ 2024-03-08 13:06:57,635 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
187
+ 2024-03-08 13:07:02,636 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
188
+ 2024-03-08 13:07:06,591 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
189
+ 2024-03-08 13:07:07,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
190
+ 2024-03-08 13:07:07,432 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
191
+ 2024-03-08 13:07:07,473 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
192
+ 2024-03-08 13:07:07,682 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
193
+ 2024-03-08 13:07:12,683 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
194
+ 2024-03-08 13:07:17,684 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
195
+ 2024-03-08 13:07:22,432 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
196
+ 2024-03-08 13:07:22,433 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
197
+ 2024-03-08 13:07:22,473 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
198
+ 2024-03-08 13:07:23,648 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
199
+ 2024-03-08 13:07:28,649 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
200
+ 2024-03-08 13:07:33,635 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: partial_history
201
+ 2024-03-08 13:07:33,637 DEBUG SenderThread:25394 [sender.py:send():378] send: history
202
+ 2024-03-08 13:07:33,637 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: summary_record
203
+ 2024-03-08 13:07:33,638 INFO SenderThread:25394 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
204
+ 2024-03-08 13:07:33,676 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
205
+ 2024-03-08 13:07:34,458 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json
206
+ 2024-03-08 13:07:36,459 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/output.log
207
+ 2024-03-08 13:07:36,592 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
208
+ 2024-03-08 13:07:37,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
209
+ 2024-03-08 13:07:37,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
210
+ 2024-03-08 13:07:37,434 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
211
+ 2024-03-08 13:07:38,284 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: partial_history
212
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
213
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
214
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
215
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
216
+ 2024-03-08 13:07:38,286 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
217
+ 2024-03-08 13:07:38,287 DEBUG SenderThread:25394 [sender.py:send():378] send: history
218
+ 2024-03-08 13:07:38,287 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: summary_record
219
+ 2024-03-08 13:07:38,287 INFO SenderThread:25394 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
220
+ 2024-03-08 13:07:38,460 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json
221
+ 2024-03-08 13:07:39,288 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
222
+ 2024-03-08 13:07:44,293 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
223
+ 2024-03-08 13:07:45,462 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/config.yaml
224
+ 2024-03-08 13:07:49,581 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
225
+ 2024-03-08 13:07:52,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
226
+ 2024-03-08 13:07:52,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
227
+ 2024-03-08 13:07:52,434 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
228
+ 2024-03-08 13:07:54,708 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
229
+ 2024-03-08 13:07:59,710 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
230
+ 2024-03-08 13:08:04,711 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
231
+ 2024-03-08 13:08:06,593 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
232
+ 2024-03-08 13:08:07,433 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
233
+ 2024-03-08 13:08:07,433 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
234
+ 2024-03-08 13:08:07,474 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
235
+ 2024-03-08 13:08:10,623 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_130200-qomx2zsg/run-qomx2zsg.wandb CHANGED
Binary files a/wandb/run-20240308_130200-qomx2zsg/run-qomx2zsg.wandb and b/wandb/run-20240308_130200-qomx2zsg/run-qomx2zsg.wandb differ