Training in progress, step 200
Browse files
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 485755120
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:deadc373a2d335f5d2d2925e03f81e5104092fe48323dd8224d13f364f9b8034
|
| 3 |
size 485755120
|
wandb/debug-internal.log
CHANGED
|
@@ -217,3 +217,50 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 217 |
2024-06-02 21:29:44,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 218 |
2024-06-02 21:29:44,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 219 |
2024-06-02 21:29:49,924 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 217 |
2024-06-02 21:29:44,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 218 |
2024-06-02 21:29:44,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 219 |
2024-06-02 21:29:49,924 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 220 |
+
2024-06-02 21:29:54,925 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 221 |
+
2024-06-02 21:29:59,840 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 222 |
+
2024-06-02 21:29:59,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 223 |
+
2024-06-02 21:29:59,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 224 |
+
2024-06-02 21:29:59,960 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 225 |
+
2024-06-02 21:30:04,961 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 226 |
+
2024-06-02 21:30:09,962 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 227 |
+
2024-06-02 21:30:13,529 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 228 |
+
2024-06-02 21:30:14,840 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 229 |
+
2024-06-02 21:30:14,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 230 |
+
2024-06-02 21:30:14,881 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 231 |
+
2024-06-02 21:30:15,951 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 232 |
+
2024-06-02 21:30:20,952 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 233 |
+
2024-06-02 21:30:25,953 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 234 |
+
2024-06-02 21:30:29,840 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 235 |
+
2024-06-02 21:30:29,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 236 |
+
2024-06-02 21:30:29,881 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 237 |
+
2024-06-02 21:30:31,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 238 |
+
2024-06-02 21:30:36,933 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 239 |
+
2024-06-02 21:30:41,934 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 240 |
+
2024-06-02 21:30:43,530 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 241 |
+
2024-06-02 21:30:44,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 242 |
+
2024-06-02 21:30:44,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 243 |
+
2024-06-02 21:30:44,874 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 244 |
+
2024-06-02 21:30:47,876 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 245 |
+
2024-06-02 21:30:52,877 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 246 |
+
2024-06-02 21:30:57,877 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 247 |
+
2024-06-02 21:30:59,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 248 |
+
2024-06-02 21:30:59,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 249 |
+
2024-06-02 21:30:59,881 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 250 |
+
2024-06-02 21:31:02,944 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 251 |
+
2024-06-02 21:31:07,945 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 252 |
+
2024-06-02 21:31:12,946 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 253 |
+
2024-06-02 21:31:13,531 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 254 |
+
2024-06-02 21:31:14,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 255 |
+
2024-06-02 21:31:14,842 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 256 |
+
2024-06-02 21:31:14,882 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 257 |
+
2024-06-02 21:31:18,903 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 258 |
+
2024-06-02 21:31:23,904 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 259 |
+
2024-06-02 21:31:28,905 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 260 |
+
2024-06-02 21:31:30,193 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 261 |
+
2024-06-02 21:31:30,195 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 262 |
+
2024-06-02 21:31:30,195 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 263 |
+
2024-06-02 21:31:34,603 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 264 |
+
2024-06-02 21:31:34,663 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 265 |
+
2024-06-02 21:31:39,664 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 266 |
+
2024-06-02 21:31:43,532 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
wandb/run-20240602_212342-ypv2rcj7/files/output.log
CHANGED
|
@@ -6,4 +6,6 @@
|
|
| 6 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 7 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 8 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
|
|
|
|
|
|
| 9 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
|
|
|
| 6 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 7 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 8 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 9 |
+
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 10 |
+
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 11 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
wandb/run-20240602_212342-ypv2rcj7/logs/debug-internal.log
CHANGED
|
@@ -217,3 +217,50 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 217 |
2024-06-02 21:29:44,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 218 |
2024-06-02 21:29:44,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 219 |
2024-06-02 21:29:49,924 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 217 |
2024-06-02 21:29:44,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 218 |
2024-06-02 21:29:44,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 219 |
2024-06-02 21:29:49,924 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 220 |
+
2024-06-02 21:29:54,925 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 221 |
+
2024-06-02 21:29:59,840 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 222 |
+
2024-06-02 21:29:59,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 223 |
+
2024-06-02 21:29:59,880 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 224 |
+
2024-06-02 21:29:59,960 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 225 |
+
2024-06-02 21:30:04,961 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 226 |
+
2024-06-02 21:30:09,962 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 227 |
+
2024-06-02 21:30:13,529 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 228 |
+
2024-06-02 21:30:14,840 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 229 |
+
2024-06-02 21:30:14,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 230 |
+
2024-06-02 21:30:14,881 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 231 |
+
2024-06-02 21:30:15,951 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 232 |
+
2024-06-02 21:30:20,952 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 233 |
+
2024-06-02 21:30:25,953 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 234 |
+
2024-06-02 21:30:29,840 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 235 |
+
2024-06-02 21:30:29,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 236 |
+
2024-06-02 21:30:29,881 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 237 |
+
2024-06-02 21:30:31,932 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 238 |
+
2024-06-02 21:30:36,933 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 239 |
+
2024-06-02 21:30:41,934 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 240 |
+
2024-06-02 21:30:43,530 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 241 |
+
2024-06-02 21:30:44,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 242 |
+
2024-06-02 21:30:44,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 243 |
+
2024-06-02 21:30:44,874 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 244 |
+
2024-06-02 21:30:47,876 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 245 |
+
2024-06-02 21:30:52,877 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 246 |
+
2024-06-02 21:30:57,877 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 247 |
+
2024-06-02 21:30:59,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 248 |
+
2024-06-02 21:30:59,841 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 249 |
+
2024-06-02 21:30:59,881 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 250 |
+
2024-06-02 21:31:02,944 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 251 |
+
2024-06-02 21:31:07,945 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 252 |
+
2024-06-02 21:31:12,946 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 253 |
+
2024-06-02 21:31:13,531 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
| 254 |
+
2024-06-02 21:31:14,841 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 255 |
+
2024-06-02 21:31:14,842 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 256 |
+
2024-06-02 21:31:14,882 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 257 |
+
2024-06-02 21:31:18,903 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 258 |
+
2024-06-02 21:31:23,904 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 259 |
+
2024-06-02 21:31:28,905 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 260 |
+
2024-06-02 21:31:30,193 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: internal_messages
|
| 261 |
+
2024-06-02 21:31:30,195 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: stop_status
|
| 262 |
+
2024-06-02 21:31:30,195 DEBUG SenderThread:82 [sender.py:send_request():406] send_request: stop_status
|
| 263 |
+
2024-06-02 21:31:34,603 INFO Thread-12 :82 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_212342-ypv2rcj7/files/output.log
|
| 264 |
+
2024-06-02 21:31:34,663 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 265 |
+
2024-06-02 21:31:39,664 DEBUG HandlerThread:82 [handler.py:handle_request():146] handle_request: status_report
|
| 266 |
+
2024-06-02 21:31:43,532 DEBUG SenderThread:82 [sender.py:send():379] send: stats
|
wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb
CHANGED
|
Binary files a/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb and b/wandb/run-20240602_212342-ypv2rcj7/run-ypv2rcj7.wandb differ
|
|
|