sharukat commited on
Commit
243e208
·
verified ·
1 Parent(s): 4e982c1

Training in progress, epoch 3

Browse files
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bc9377fc78fec87d4d2a3e3ee34912159c9f3a17e95f81b6df19d0cc5f1250fb
3
  size 596114452
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1274ae69934a0d86c0b799a83064d724dd2fbab1b3dca71951d2c6e095f18e1f
3
  size 596114452
runs/Apr10_16-17-22_ae604480b8c9/events.out.tfevents.1712765843.ae604480b8c9.34.4 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:15cdd3b337bd2d705f1ad71a9615b390dc8b69a9bb14a22a4eb1f85fab853d2d
3
- size 6636
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:256b16c6ee4ead2af42a77b1efab1ad3110f664093adcf54e24f9e316fda1c33
3
+ size 7319
wandb/debug-internal.log CHANGED
@@ -1496,3 +1496,40 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
1496
  2024-04-10 16:19:37,716 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1497
  2024-04-10 16:19:37,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1498
  2024-04-10 16:19:38,846 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1496
  2024-04-10 16:19:37,716 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1497
  2024-04-10 16:19:37,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1498
  2024-04-10 16:19:38,846 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1499
+ 2024-04-10 16:19:43,847 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1500
+ 2024-04-10 16:19:48,848 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1501
+ 2024-04-10 16:19:51,880 DEBUG SenderThread:98 [sender.py:send():379] send: stats
1502
+ 2024-04-10 16:19:52,447 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: internal_messages
1503
+ 2024-04-10 16:19:52,716 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1504
+ 2024-04-10 16:19:52,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1505
+ 2024-04-10 16:19:54,819 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1506
+ 2024-04-10 16:19:59,820 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1507
+ 2024-04-10 16:20:04,821 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1508
+ 2024-04-10 16:20:07,447 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: internal_messages
1509
+ 2024-04-10 16:20:07,716 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1510
+ 2024-04-10 16:20:07,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1511
+ 2024-04-10 16:20:10,776 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1512
+ 2024-04-10 16:20:15,777 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1513
+ 2024-04-10 16:20:19,372 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: partial_history
1514
+ 2024-04-10 16:20:19,373 DEBUG SenderThread:98 [sender.py:send():379] send: history
1515
+ 2024-04-10 16:20:19,374 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: summary_record
1516
+ 2024-04-10 16:20:19,374 INFO SenderThread:98 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
1517
+ 2024-04-10 16:20:19,764 INFO Thread-12 :98 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240410_155650-albqrbhg/files/wandb-summary.json
1518
+ 2024-04-10 16:20:21,375 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1519
+ 2024-04-10 16:20:21,881 DEBUG SenderThread:98 [sender.py:send():379] send: stats
1520
+ 2024-04-10 16:20:22,447 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: internal_messages
1521
+ 2024-04-10 16:20:22,717 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1522
+ 2024-04-10 16:20:22,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1523
+ 2024-04-10 16:20:24,636 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: partial_history
1524
+ 2024-04-10 16:20:24,638 DEBUG SenderThread:98 [sender.py:send():379] send: history
1525
+ 2024-04-10 16:20:24,638 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: summary_record
1526
+ 2024-04-10 16:20:24,638 INFO SenderThread:98 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
1527
+ 2024-04-10 16:20:24,766 INFO Thread-12 :98 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240410_155650-albqrbhg/files/wandb-summary.json
1528
+ 2024-04-10 16:20:26,639 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1529
+ 2024-04-10 16:20:27,768 INFO Thread-12 :98 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240410_155650-albqrbhg/files/output.log
1530
+ 2024-04-10 16:20:31,640 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1531
+ 2024-04-10 16:20:36,641 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1532
+ 2024-04-10 16:20:37,447 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: internal_messages
1533
+ 2024-04-10 16:20:37,717 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1534
+ 2024-04-10 16:20:37,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1535
+ 2024-04-10 16:20:41,868 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240410_155650-albqrbhg/files/output.log CHANGED
@@ -86,4 +86,6 @@ dataloader_config = DataLoaderConfiguration(dispatch_batches=None, split_batches
86
  warnings.warn(
87
  /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
88
  _warn_prf(average, modifier, msg_start, len(result))
 
 
89
  /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
 
86
  warnings.warn(
87
  /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
88
  _warn_prf(average, modifier, msg_start, len(result))
89
+ /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
90
+ _warn_prf(average, modifier, msg_start, len(result))
91
  /opt/conda/lib/python3.10/site-packages/sklearn/metrics/_classification.py:1344: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
wandb/run-20240410_155650-albqrbhg/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 1.9323, "train/grad_norm": 6.981883525848389, "train/learning_rate": 6e-06, "train/epoch": 2.0, "train/global_step": 118, "_timestamp": 1712765962.4548702, "_runtime": 1352.1864693164825, "_step": 5, "eval/loss": 1.9262523651123047, "eval/accuracy": 0.19718309859154928, "eval/precision": 0.02816901408450704, "eval/recall": 0.14285714285714285, "eval/f1": 0.047058823529411764, "eval/runtime": 5.3003, "eval/samples_per_second": 26.791, "eval/steps_per_second": 1.698}
 
1
+ {"train/loss": 1.9283, "train/grad_norm": 5.247864246368408, "train/learning_rate": 4.000000000000001e-06, "train/epoch": 3.0, "train/global_step": 177, "_timestamp": 1712766024.6362326, "_runtime": 1414.3678317070007, "_step": 7, "eval/loss": 1.9281846284866333, "eval/accuracy": 0.2112676056338028, "eval/precision": 0.12401507365536142, "eval/recall": 0.15238095238095237, "eval/f1": 0.06522020893278378, "eval/runtime": 5.2594, "eval/samples_per_second": 26.999, "eval/steps_per_second": 1.711}
wandb/run-20240410_155650-albqrbhg/logs/debug-internal.log CHANGED
@@ -1496,3 +1496,40 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
1496
  2024-04-10 16:19:37,716 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1497
  2024-04-10 16:19:37,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1498
  2024-04-10 16:19:38,846 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1496
  2024-04-10 16:19:37,716 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1497
  2024-04-10 16:19:37,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1498
  2024-04-10 16:19:38,846 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1499
+ 2024-04-10 16:19:43,847 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1500
+ 2024-04-10 16:19:48,848 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1501
+ 2024-04-10 16:19:51,880 DEBUG SenderThread:98 [sender.py:send():379] send: stats
1502
+ 2024-04-10 16:19:52,447 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: internal_messages
1503
+ 2024-04-10 16:19:52,716 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1504
+ 2024-04-10 16:19:52,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1505
+ 2024-04-10 16:19:54,819 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1506
+ 2024-04-10 16:19:59,820 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1507
+ 2024-04-10 16:20:04,821 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1508
+ 2024-04-10 16:20:07,447 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: internal_messages
1509
+ 2024-04-10 16:20:07,716 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1510
+ 2024-04-10 16:20:07,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1511
+ 2024-04-10 16:20:10,776 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1512
+ 2024-04-10 16:20:15,777 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1513
+ 2024-04-10 16:20:19,372 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: partial_history
1514
+ 2024-04-10 16:20:19,373 DEBUG SenderThread:98 [sender.py:send():379] send: history
1515
+ 2024-04-10 16:20:19,374 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: summary_record
1516
+ 2024-04-10 16:20:19,374 INFO SenderThread:98 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
1517
+ 2024-04-10 16:20:19,764 INFO Thread-12 :98 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240410_155650-albqrbhg/files/wandb-summary.json
1518
+ 2024-04-10 16:20:21,375 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1519
+ 2024-04-10 16:20:21,881 DEBUG SenderThread:98 [sender.py:send():379] send: stats
1520
+ 2024-04-10 16:20:22,447 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: internal_messages
1521
+ 2024-04-10 16:20:22,717 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1522
+ 2024-04-10 16:20:22,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1523
+ 2024-04-10 16:20:24,636 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: partial_history
1524
+ 2024-04-10 16:20:24,638 DEBUG SenderThread:98 [sender.py:send():379] send: history
1525
+ 2024-04-10 16:20:24,638 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: summary_record
1526
+ 2024-04-10 16:20:24,638 INFO SenderThread:98 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
1527
+ 2024-04-10 16:20:24,766 INFO Thread-12 :98 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240410_155650-albqrbhg/files/wandb-summary.json
1528
+ 2024-04-10 16:20:26,639 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1529
+ 2024-04-10 16:20:27,768 INFO Thread-12 :98 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240410_155650-albqrbhg/files/output.log
1530
+ 2024-04-10 16:20:31,640 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1531
+ 2024-04-10 16:20:36,641 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
1532
+ 2024-04-10 16:20:37,447 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: internal_messages
1533
+ 2024-04-10 16:20:37,717 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: stop_status
1534
+ 2024-04-10 16:20:37,717 DEBUG SenderThread:98 [sender.py:send_request():406] send_request: stop_status
1535
+ 2024-04-10 16:20:41,868 DEBUG HandlerThread:98 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240410_155650-albqrbhg/run-albqrbhg.wandb CHANGED
Binary files a/wandb/run-20240410_155650-albqrbhg/run-albqrbhg.wandb and b/wandb/run-20240410_155650-albqrbhg/run-albqrbhg.wandb differ