nornor02 commited on
Commit
7210d76
·
verified ·
1 Parent(s): 9267531

Training in progress, step 1000

Browse files
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2b28a18e29df773bbc3a32d15864c5b26cd5724a33574ead97c39722e009e0b7
3
  size 328693404
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9d3fd5ff80c259ad25f175097a4810e505b1c56977d183c1c61b912c7f27f79
3
  size 328693404
runs/Jan18_13-38-00_63fa7140292f/events.out.tfevents.1705585211.63fa7140292f.26.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63caa33a433f7e421a3751cea5ef8ab2ff8e81d2c2d789131f9e6acda77f4cad
3
- size 4522
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:527b1e485cffd6a8c0a002fe993f177dac537844a366f0dddfc5333e2d1fb8e5
3
+ size 4679
wandb/debug-internal.log CHANGED
@@ -105,3 +105,49 @@
105
  2024-01-18 13:42:20,970 INFO SenderThread:96 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
106
  2024-01-18 13:42:21,783 INFO Thread-12 :96 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/wandb-summary.json
107
  2024-01-18 13:42:21,971 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
105
  2024-01-18 13:42:20,970 INFO SenderThread:96 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
106
  2024-01-18 13:42:21,783 INFO Thread-12 :96 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/wandb-summary.json
107
  2024-01-18 13:42:21,971 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
108
+ 2024-01-18 13:42:24,859 DEBUG SenderThread:96 [sender.py:send():382] send: stats
109
+ 2024-01-18 13:42:25,001 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
110
+ 2024-01-18 13:42:25,785 INFO Thread-12 :96 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/output.log
111
+ 2024-01-18 13:42:27,865 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
112
+ 2024-01-18 13:42:28,786 INFO Thread-12 :96 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/config.yaml
113
+ 2024-01-18 13:42:30,010 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
114
+ 2024-01-18 13:42:32,979 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
115
+ 2024-01-18 13:42:35,014 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
116
+ 2024-01-18 13:42:37,980 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
117
+ 2024-01-18 13:42:40,016 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
118
+ 2024-01-18 13:42:42,981 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
119
+ 2024-01-18 13:42:45,017 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
120
+ 2024-01-18 13:42:47,982 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
121
+ 2024-01-18 13:42:50,018 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
122
+ 2024-01-18 13:42:52,983 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
123
+ 2024-01-18 13:42:54,860 DEBUG SenderThread:96 [sender.py:send():382] send: stats
124
+ 2024-01-18 13:42:55,019 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
125
+ 2024-01-18 13:42:58,861 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
126
+ 2024-01-18 13:43:00,025 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
127
+ 2024-01-18 13:43:03,862 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
128
+ 2024-01-18 13:43:05,028 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
129
+ 2024-01-18 13:43:08,863 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
130
+ 2024-01-18 13:43:10,029 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
131
+ 2024-01-18 13:43:13,864 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
132
+ 2024-01-18 13:43:15,030 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
133
+ 2024-01-18 13:43:18,864 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
134
+ 2024-01-18 13:43:20,031 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
135
+ 2024-01-18 13:43:23,865 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
136
+ 2024-01-18 13:43:24,861 DEBUG SenderThread:96 [sender.py:send():382] send: stats
137
+ 2024-01-18 13:43:25,037 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
138
+ 2024-01-18 13:43:29,862 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
139
+ 2024-01-18 13:43:30,038 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
140
+ 2024-01-18 13:43:34,863 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
141
+ 2024-01-18 13:43:35,039 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
142
+ 2024-01-18 13:43:39,864 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
143
+ 2024-01-18 13:43:40,045 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
144
+ 2024-01-18 13:43:44,865 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
145
+ 2024-01-18 13:43:45,048 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
146
+ 2024-01-18 13:43:47,934 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: partial_history
147
+ 2024-01-18 13:43:47,935 DEBUG SenderThread:96 [sender.py:send():382] send: history
148
+ 2024-01-18 13:43:47,935 DEBUG SenderThread:96 [sender.py:send_request():409] send_request: summary_record
149
+ 2024-01-18 13:43:47,937 INFO SenderThread:96 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
150
+ 2024-01-18 13:43:48,817 INFO Thread-12 :96 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/wandb-summary.json
151
+ 2024-01-18 13:43:49,938 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
152
+ 2024-01-18 13:43:50,062 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
153
+ 2024-01-18 13:43:51,818 INFO Thread-12 :96 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/output.log
wandb/run-20240118_134024-yplhy9pj/files/config.yaml CHANGED
@@ -54,6 +54,18 @@ _wandb:
54
  - 1: train/global_step
55
  6:
56
  - 3
 
 
 
 
 
 
 
 
 
 
 
 
57
  return_dict:
58
  desc: null
59
  value: true
 
54
  - 1: train/global_step
55
  6:
56
  - 3
57
+ - 1: train/loss
58
+ 5: 1
59
+ 6:
60
+ - 1
61
+ - 1: train/learning_rate
62
+ 5: 1
63
+ 6:
64
+ - 1
65
+ - 1: train/epoch
66
+ 5: 1
67
+ 6:
68
+ - 1
69
  return_dict:
70
  desc: null
71
  value: true
wandb/run-20240118_134024-yplhy9pj/files/output.log CHANGED
@@ -1,2 +1,6 @@
1
  You're using a PreTrainedTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.
 
 
 
 
2
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
 
1
  You're using a PreTrainedTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.
2
+ /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
3
+ warnings.warn('Was asked to gather along dimension 0, but all '
4
+ /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
5
+ warnings.warn('Was asked to gather along dimension 0, but all '
6
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
wandb/run-20240118_134024-yplhy9pj/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 2.993, "train/learning_rate": 1.6153846153846154e-05, "train/epoch": 38.46, "train/global_step": 500, "_timestamp": 1705585340.9651291, "_runtime": 116.75942611694336, "_step": 0}
 
1
+ {"train/loss": 2.1182, "train/learning_rate": 1.230769230769231e-05, "train/epoch": 76.92, "train/global_step": 1000, "_timestamp": 1705585427.933702, "_runtime": 203.7279989719391, "_step": 1}
wandb/run-20240118_134024-yplhy9pj/logs/debug-internal.log CHANGED
@@ -105,3 +105,49 @@
105
  2024-01-18 13:42:20,970 INFO SenderThread:96 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
106
  2024-01-18 13:42:21,783 INFO Thread-12 :96 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/wandb-summary.json
107
  2024-01-18 13:42:21,971 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
105
  2024-01-18 13:42:20,970 INFO SenderThread:96 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
106
  2024-01-18 13:42:21,783 INFO Thread-12 :96 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/wandb-summary.json
107
  2024-01-18 13:42:21,971 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
108
+ 2024-01-18 13:42:24,859 DEBUG SenderThread:96 [sender.py:send():382] send: stats
109
+ 2024-01-18 13:42:25,001 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
110
+ 2024-01-18 13:42:25,785 INFO Thread-12 :96 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/output.log
111
+ 2024-01-18 13:42:27,865 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
112
+ 2024-01-18 13:42:28,786 INFO Thread-12 :96 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/config.yaml
113
+ 2024-01-18 13:42:30,010 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
114
+ 2024-01-18 13:42:32,979 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
115
+ 2024-01-18 13:42:35,014 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
116
+ 2024-01-18 13:42:37,980 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
117
+ 2024-01-18 13:42:40,016 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
118
+ 2024-01-18 13:42:42,981 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
119
+ 2024-01-18 13:42:45,017 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
120
+ 2024-01-18 13:42:47,982 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
121
+ 2024-01-18 13:42:50,018 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
122
+ 2024-01-18 13:42:52,983 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
123
+ 2024-01-18 13:42:54,860 DEBUG SenderThread:96 [sender.py:send():382] send: stats
124
+ 2024-01-18 13:42:55,019 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
125
+ 2024-01-18 13:42:58,861 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
126
+ 2024-01-18 13:43:00,025 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
127
+ 2024-01-18 13:43:03,862 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
128
+ 2024-01-18 13:43:05,028 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
129
+ 2024-01-18 13:43:08,863 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
130
+ 2024-01-18 13:43:10,029 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
131
+ 2024-01-18 13:43:13,864 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
132
+ 2024-01-18 13:43:15,030 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
133
+ 2024-01-18 13:43:18,864 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
134
+ 2024-01-18 13:43:20,031 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
135
+ 2024-01-18 13:43:23,865 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
136
+ 2024-01-18 13:43:24,861 DEBUG SenderThread:96 [sender.py:send():382] send: stats
137
+ 2024-01-18 13:43:25,037 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
138
+ 2024-01-18 13:43:29,862 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
139
+ 2024-01-18 13:43:30,038 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
140
+ 2024-01-18 13:43:34,863 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
141
+ 2024-01-18 13:43:35,039 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
142
+ 2024-01-18 13:43:39,864 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
143
+ 2024-01-18 13:43:40,045 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
144
+ 2024-01-18 13:43:44,865 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
145
+ 2024-01-18 13:43:45,048 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
146
+ 2024-01-18 13:43:47,934 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: partial_history
147
+ 2024-01-18 13:43:47,935 DEBUG SenderThread:96 [sender.py:send():382] send: history
148
+ 2024-01-18 13:43:47,935 DEBUG SenderThread:96 [sender.py:send_request():409] send_request: summary_record
149
+ 2024-01-18 13:43:47,937 INFO SenderThread:96 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
150
+ 2024-01-18 13:43:48,817 INFO Thread-12 :96 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/wandb-summary.json
151
+ 2024-01-18 13:43:49,938 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: status_report
152
+ 2024-01-18 13:43:50,062 DEBUG HandlerThread:96 [handler.py:handle_request():146] handle_request: keepalive
153
+ 2024-01-18 13:43:51,818 INFO Thread-12 :96 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240118_134024-yplhy9pj/files/output.log
wandb/run-20240118_134024-yplhy9pj/run-yplhy9pj.wandb CHANGED
Binary files a/wandb/run-20240118_134024-yplhy9pj/run-yplhy9pj.wandb and b/wandb/run-20240118_134024-yplhy9pj/run-yplhy9pj.wandb differ