Hugging Face's logo

nornor02
/
working

Fill-Mask
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files
xet
 Metrics Community
nornor02 commited on
Commit
03b21f1
·
1 Parent(s): dacb602

End of training

Browse files
Files changed (12) hide show
  1. README.md +54 -0
  2. model.safetensors +1 -1
  3. runs/Dec21_04-04-18_c79b7fd35412/events.out.tfevents.1703131459.c79b7fd35412.42.0 +2 -2
  4. runs/Dec21_04-04-18_c79b7fd35412/events.out.tfevents.1703132018.c79b7fd35412.42.1 +3 -0
  5. wandb/debug-internal.log +98 -0
  6. wandb/debug.log +6 -0
  7. wandb/run-20231221_040446-s5p2d29k/files/config.yaml +20 -0
  8. wandb/run-20231221_040446-s5p2d29k/files/output.log +1 -0
  9. wandb/run-20231221_040446-s5p2d29k/files/wandb-summary.json +1 -1
  10. wandb/run-20231221_040446-s5p2d29k/logs/debug-internal.log +98 -0
  11. wandb/run-20231221_040446-s5p2d29k/logs/debug.log +6 -0
  12. wandb/run-20231221_040446-s5p2d29k/run-s5p2d29k.wandb +0 -0
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: distilroberta-base
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: working
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # working
15
+
16
+ This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 2.0049
19
+
20
+ ## Model description
21
+
22
+ More information needed
23
+
24
+ ## Intended uses & limitations
25
+
26
+ More information needed
27
+
28
+ ## Training and evaluation data
29
+
30
+ More information needed
31
+
32
+ ## Training procedure
33
+
34
+ ### Training hyperparameters
35
+
36
+ The following hyperparameters were used during training:
37
+ - learning_rate: 2e-05
38
+ - train_batch_size: 16
39
+ - eval_batch_size: 16
40
+ - seed: 42
41
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
+ - lr_scheduler_type: linear
43
+ - num_epochs: 3
44
+
45
+ ### Training results
46
+
47
+
48
+
49
+ ### Framework versions
50
+
51
+ - Transformers 4.37.0.dev0
52
+ - Pytorch 2.0.0
53
+ - Datasets 2.1.0
54
+ - Tokenizers 0.15.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c639da569f50d8d081625db28298c09c254bde436ab0b2a236a9b3d0af7e847d
3
  size 328693404
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a9e9c2ecfc4a79caaec0213fc126c829f77cedc8989a506888c95f4ccf1adba
3
  size 328693404
runs/Dec21_04-04-18_c79b7fd35412/events.out.tfevents.1703131459.c79b7fd35412.42.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fb1d54af0f7f980f39b62fd8d322de9a710a86513e1fd49827ac6feb64299fa3
3
- size 4841
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2c4f3c026442b4a8530d5eee711741cfb33ef75970de5cf9ce36c739f5d19c3
3
+ size 5195
runs/Dec21_04-04-18_c79b7fd35412/events.out.tfevents.1703132018.c79b7fd35412.42.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6cfa65b50b020c278db0db3f60a2c0d0367d939c9b9c169c78c515303a310a0
3
+ size 359
wandb/debug-internal.log CHANGED
@@ -268,3 +268,101 @@
268
  2023-12-21 04:12:27,974 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
269
  2023-12-21 04:12:31,010 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
270
  2023-12-21 04:12:32,975 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
268
  2023-12-21 04:12:27,974 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
269
  2023-12-21 04:12:31,010 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
270
  2023-12-21 04:12:32,975 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
271
+ 2023-12-21 04:12:36,011 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
272
+ 2023-12-21 04:12:37,985 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
273
+ 2023-12-21 04:12:41,012 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
274
+ 2023-12-21 04:12:42,986 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
275
+ 2023-12-21 04:12:46,013 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
276
+ 2023-12-21 04:12:47,498 DEBUG SenderThread:1204 [sender.py:send():382] send: stats
277
+ 2023-12-21 04:12:47,987 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
278
+ 2023-12-21 04:12:51,500 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
279
+ 2023-12-21 04:12:52,988 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
280
+ 2023-12-21 04:12:56,500 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
281
+ 2023-12-21 04:12:57,989 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
282
+ 2023-12-21 04:13:01,501 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
283
+ 2023-12-21 04:13:02,990 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
284
+ 2023-12-21 04:13:06,502 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
285
+ 2023-12-21 04:13:07,992 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
286
+ 2023-12-21 04:13:11,503 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
287
+ 2023-12-21 04:13:12,993 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
288
+ 2023-12-21 04:13:16,504 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
289
+ 2023-12-21 04:13:17,499 DEBUG SenderThread:1204 [sender.py:send():382] send: stats
290
+ 2023-12-21 04:13:17,999 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
291
+ 2023-12-21 04:13:22,500 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
292
+ 2023-12-21 04:13:23,001 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
293
+ 2023-12-21 04:13:23,893 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: partial_history
294
+ 2023-12-21 04:13:23,895 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
295
+ 2023-12-21 04:13:23,895 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
296
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
297
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
298
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
299
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send():382] send: history
300
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send_request():409] send_request: summary_record
301
+ 2023-12-21 04:13:23,896 INFO SenderThread:1204 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
302
+ 2023-12-21 04:13:23,899 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: pause
303
+ 2023-12-21 04:13:23,899 INFO HandlerThread:1204 [handler.py:handle_request_pause():705] stopping system metrics thread
304
+ 2023-12-21 04:13:23,900 INFO HandlerThread:1204 [system_monitor.py:finish():203] Stopping system monitor
305
+ 2023-12-21 04:13:23,900 DEBUG SystemMonitor:1204 [system_monitor.py:_start():179] Finished system metrics aggregation loop
306
+ 2023-12-21 04:13:23,900 DEBUG SystemMonitor:1204 [system_monitor.py:_start():183] Publishing last batch of metrics
307
+ 2023-12-21 04:13:23,901 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined cpu monitor
308
+ 2023-12-21 04:13:23,901 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined disk monitor
309
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined gpu monitor
310
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined memory monitor
311
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined network monitor
312
+ 2023-12-21 04:13:23,919 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: resume
313
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [handler.py:handle_request_resume():696] starting system metrics thread
314
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [system_monitor.py:start():194] Starting system monitor
315
+ 2023-12-21 04:13:23,920 INFO SystemMonitor:1204 [system_monitor.py:_start():158] Starting system asset monitoring threads
316
+ 2023-12-21 04:13:23,921 DEBUG SenderThread:1204 [sender.py:send():382] send: stats
317
+ 2023-12-21 04:13:23,921 INFO SystemMonitor:1204 [interfaces.py:start():190] Started cpu monitoring
318
+ 2023-12-21 04:13:23,922 INFO SystemMonitor:1204 [interfaces.py:start():190] Started disk monitoring
319
+ 2023-12-21 04:13:23,923 INFO SystemMonitor:1204 [interfaces.py:start():190] Started gpu monitoring
320
+ 2023-12-21 04:13:23,924 INFO SystemMonitor:1204 [interfaces.py:start():190] Started memory monitoring
321
+ 2023-12-21 04:13:23,925 INFO SystemMonitor:1204 [interfaces.py:start():190] Started network monitoring
322
+ 2023-12-21 04:13:24,565 INFO Thread-12 :1204 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_040446-s5p2d29k/files/wandb-summary.json
323
+ 2023-12-21 04:13:27,922 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
324
+ 2023-12-21 04:13:28,008 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
325
+ 2023-12-21 04:13:32,928 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
326
+ 2023-12-21 04:13:33,014 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
327
+ 2023-12-21 04:13:33,568 INFO Thread-12 :1204 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_040446-s5p2d29k/files/config.yaml
328
+ 2023-12-21 04:13:38,014 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
329
+ 2023-12-21 04:13:38,042 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
330
+ 2023-12-21 04:13:38,064 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: partial_history
331
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
332
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
333
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
334
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
335
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: history
336
+ 2023-12-21 04:13:38,068 DEBUG SenderThread:1204 [sender.py:send_request():409] send_request: summary_record
337
+ 2023-12-21 04:13:38,068 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: pause
338
+ 2023-12-21 04:13:38,069 INFO HandlerThread:1204 [handler.py:handle_request_pause():705] stopping system metrics thread
339
+ 2023-12-21 04:13:38,069 INFO HandlerThread:1204 [system_monitor.py:finish():203] Stopping system monitor
340
+ 2023-12-21 04:13:38,070 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined cpu monitor
341
+ 2023-12-21 04:13:38,070 DEBUG SystemMonitor:1204 [system_monitor.py:_start():172] Starting system metrics aggregation loop
342
+ 2023-12-21 04:13:38,070 INFO SenderThread:1204 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
343
+ 2023-12-21 04:13:38,073 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined disk monitor
344
+ 2023-12-21 04:13:38,073 DEBUG SystemMonitor:1204 [system_monitor.py:_start():179] Finished system metrics aggregation loop
345
+ 2023-12-21 04:13:38,074 DEBUG SystemMonitor:1204 [system_monitor.py:_start():183] Publishing last batch of metrics
346
+ 2023-12-21 04:13:38,086 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined gpu monitor
347
+ 2023-12-21 04:13:38,086 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined memory monitor
348
+ 2023-12-21 04:13:38,086 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined network monitor
349
+ 2023-12-21 04:13:38,087 DEBUG SenderThread:1204 [sender.py:send():382] send: stats
350
+ 2023-12-21 04:13:38,570 INFO Thread-12 :1204 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_040446-s5p2d29k/files/wandb-summary.json
351
+ 2023-12-21 04:13:40,571 INFO Thread-12 :1204 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_040446-s5p2d29k/files/output.log
352
+ 2023-12-21 04:13:43,016 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
353
+ 2023-12-21 04:13:43,088 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
354
+ 2023-12-21 04:13:48,017 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
355
+ 2023-12-21 04:13:48,089 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
356
+ 2023-12-21 04:13:48,919 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: resume
357
+ 2023-12-21 04:13:48,920 INFO HandlerThread:1204 [handler.py:handle_request_resume():696] starting system metrics thread
358
+ 2023-12-21 04:13:48,920 INFO HandlerThread:1204 [system_monitor.py:start():194] Starting system monitor
359
+ 2023-12-21 04:13:48,920 INFO SystemMonitor:1204 [system_monitor.py:_start():158] Starting system asset monitoring threads
360
+ 2023-12-21 04:13:48,921 INFO SystemMonitor:1204 [interfaces.py:start():190] Started cpu monitoring
361
+ 2023-12-21 04:13:48,921 INFO SystemMonitor:1204 [interfaces.py:start():190] Started disk monitoring
362
+ 2023-12-21 04:13:48,922 INFO SystemMonitor:1204 [interfaces.py:start():190] Started gpu monitoring
363
+ 2023-12-21 04:13:48,923 INFO SystemMonitor:1204 [interfaces.py:start():190] Started memory monitoring
364
+ 2023-12-21 04:13:48,926 INFO SystemMonitor:1204 [interfaces.py:start():190] Started network monitoring
365
+ 2023-12-21 04:13:53,018 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
366
+ 2023-12-21 04:13:53,090 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
367
+ 2023-12-21 04:13:58,019 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
368
+ 2023-12-21 04:13:58,091 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
wandb/debug.log CHANGED
@@ -28,3 +28,9 @@ config: {}
28
  2023-12-21 04:05:17,498 INFO MainThread:42 [wandb_run.py:_redirect():2178] Redirects installed.
29
  2023-12-21 04:05:17,499 INFO MainThread:42 [wandb_init.py:init():841] run started, returning control to user process
30
  2023-12-21 04:05:17,506 INFO MainThread:42 [wandb_run.py:_config_callback():1342] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['RobertaForMaskedLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 1, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'distilroberta-base', 'transformers_version': '4.37.0.dev0', 'model_type': 'roberta', 'vocab_size': 50265, 'hidden_size': 768, 'num_hidden_layers': 6, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.1, 'attention_probs_dropout_prob': 0.1, 'max_position_embeddings': 514, 'type_vocab_size': 1, 'initializer_range': 0.02, 'layer_norm_eps': 1e-05, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 3, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Dec21_04-04-18_c79b7fd35412', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
 
 
 
 
 
 
 
28
  2023-12-21 04:05:17,498 INFO MainThread:42 [wandb_run.py:_redirect():2178] Redirects installed.
29
  2023-12-21 04:05:17,499 INFO MainThread:42 [wandb_init.py:init():841] run started, returning control to user process
30
  2023-12-21 04:05:17,506 INFO MainThread:42 [wandb_run.py:_config_callback():1342] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['RobertaForMaskedLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 1, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'distilroberta-base', 'transformers_version': '4.37.0.dev0', 'model_type': 'roberta', 'vocab_size': 50265, 'hidden_size': 768, 'num_hidden_layers': 6, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.1, 'attention_probs_dropout_prob': 0.1, 'max_position_embeddings': 514, 'type_vocab_size': 1, 'initializer_range': 0.02, 'layer_norm_eps': 1e-05, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 3, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Dec21_04-04-18_c79b7fd35412', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
31
+ 2023-12-21 04:13:23,899 INFO MainThread:42 [jupyter.py:save_ipynb():373] not saving jupyter notebook
32
+ 2023-12-21 04:13:23,899 INFO MainThread:42 [wandb_init.py:_pause_backend():435] pausing backend
33
+ 2023-12-21 04:13:23,905 INFO MainThread:42 [wandb_init.py:_resume_backend():440] resuming backend
34
+ 2023-12-21 04:13:38,065 INFO MainThread:42 [jupyter.py:save_ipynb():373] not saving jupyter notebook
35
+ 2023-12-21 04:13:38,065 INFO MainThread:42 [wandb_init.py:_pause_backend():435] pausing backend
36
+ 2023-12-21 04:13:48,919 INFO MainThread:42 [wandb_init.py:_resume_backend():440] resuming backend
wandb/run-20231221_040446-s5p2d29k/files/config.yaml CHANGED
@@ -66,6 +66,26 @@ _wandb:
66
  5: 1
67
  6:
68
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69
  return_dict:
70
  desc: null
71
  value: true
 
66
  5: 1
67
  6:
68
  - 1
69
+ - 1: train/train_runtime
70
+ 5: 1
71
+ 6:
72
+ - 1
73
+ - 1: train/train_samples_per_second
74
+ 5: 1
75
+ 6:
76
+ - 1
77
+ - 1: train/train_steps_per_second
78
+ 5: 1
79
+ 6:
80
+ - 1
81
+ - 1: train/total_flos
82
+ 5: 1
83
+ 6:
84
+ - 1
85
+ - 1: train/train_loss
86
+ 5: 1
87
+ 6:
88
+ - 1
89
  return_dict:
90
  desc: null
91
  value: true
wandb/run-20231221_040446-s5p2d29k/files/output.log CHANGED
@@ -6,3 +6,4 @@ You're using a RobertaTokenizerFast tokenizer. Please note that with a fast toke
6
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
7
  warnings.warn('Was asked to gather along dimension 0, but all '
8
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
 
 
6
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
7
  warnings.warn('Was asked to gather along dimension 0, but all '
8
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
9
+ warnings.warn('Was asked to gather along dimension 0, but all '
wandb/run-20231221_040446-s5p2d29k/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 2.158, "train/learning_rate": 2.6388888888888893e-06, "train/epoch": 2.6, "train/global_step": 1500, "_timestamp": 1703131938.694379, "_runtime": 451.8421549797058, "_step": 2}
 
1
+ {"train/loss": 2.158, "train/learning_rate": 2.6388888888888893e-06, "train/epoch": 3.0, "train/global_step": 1728, "_timestamp": 1703132018.0640366, "_runtime": 531.2118124961853, "_step": 4, "train/train_runtime": 544.6087, "train/train_samples_per_second": 50.695, "train/train_steps_per_second": 3.173, "train/total_flos": 915388864549632.0, "train/train_loss": 2.2031195252029985, "eval/loss": 2.004880905151367, "eval/runtime": 14.151, "eval/samples_per_second": 152.074, "eval/steps_per_second": 9.54}
wandb/run-20231221_040446-s5p2d29k/logs/debug-internal.log CHANGED
@@ -268,3 +268,101 @@
268
  2023-12-21 04:12:27,974 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
269
  2023-12-21 04:12:31,010 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
270
  2023-12-21 04:12:32,975 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
268
  2023-12-21 04:12:27,974 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
269
  2023-12-21 04:12:31,010 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
270
  2023-12-21 04:12:32,975 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
271
+ 2023-12-21 04:12:36,011 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
272
+ 2023-12-21 04:12:37,985 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
273
+ 2023-12-21 04:12:41,012 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
274
+ 2023-12-21 04:12:42,986 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
275
+ 2023-12-21 04:12:46,013 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
276
+ 2023-12-21 04:12:47,498 DEBUG SenderThread:1204 [sender.py:send():382] send: stats
277
+ 2023-12-21 04:12:47,987 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
278
+ 2023-12-21 04:12:51,500 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
279
+ 2023-12-21 04:12:52,988 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
280
+ 2023-12-21 04:12:56,500 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
281
+ 2023-12-21 04:12:57,989 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
282
+ 2023-12-21 04:13:01,501 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
283
+ 2023-12-21 04:13:02,990 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
284
+ 2023-12-21 04:13:06,502 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
285
+ 2023-12-21 04:13:07,992 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
286
+ 2023-12-21 04:13:11,503 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
287
+ 2023-12-21 04:13:12,993 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
288
+ 2023-12-21 04:13:16,504 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
289
+ 2023-12-21 04:13:17,499 DEBUG SenderThread:1204 [sender.py:send():382] send: stats
290
+ 2023-12-21 04:13:17,999 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
291
+ 2023-12-21 04:13:22,500 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
292
+ 2023-12-21 04:13:23,001 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
293
+ 2023-12-21 04:13:23,893 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: partial_history
294
+ 2023-12-21 04:13:23,895 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
295
+ 2023-12-21 04:13:23,895 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
296
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
297
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
298
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
299
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send():382] send: history
300
+ 2023-12-21 04:13:23,896 DEBUG SenderThread:1204 [sender.py:send_request():409] send_request: summary_record
301
+ 2023-12-21 04:13:23,896 INFO SenderThread:1204 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
302
+ 2023-12-21 04:13:23,899 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: pause
303
+ 2023-12-21 04:13:23,899 INFO HandlerThread:1204 [handler.py:handle_request_pause():705] stopping system metrics thread
304
+ 2023-12-21 04:13:23,900 INFO HandlerThread:1204 [system_monitor.py:finish():203] Stopping system monitor
305
+ 2023-12-21 04:13:23,900 DEBUG SystemMonitor:1204 [system_monitor.py:_start():179] Finished system metrics aggregation loop
306
+ 2023-12-21 04:13:23,900 DEBUG SystemMonitor:1204 [system_monitor.py:_start():183] Publishing last batch of metrics
307
+ 2023-12-21 04:13:23,901 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined cpu monitor
308
+ 2023-12-21 04:13:23,901 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined disk monitor
309
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined gpu monitor
310
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined memory monitor
311
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined network monitor
312
+ 2023-12-21 04:13:23,919 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: resume
313
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [handler.py:handle_request_resume():696] starting system metrics thread
314
+ 2023-12-21 04:13:23,919 INFO HandlerThread:1204 [system_monitor.py:start():194] Starting system monitor
315
+ 2023-12-21 04:13:23,920 INFO SystemMonitor:1204 [system_monitor.py:_start():158] Starting system asset monitoring threads
316
+ 2023-12-21 04:13:23,921 DEBUG SenderThread:1204 [sender.py:send():382] send: stats
317
+ 2023-12-21 04:13:23,921 INFO SystemMonitor:1204 [interfaces.py:start():190] Started cpu monitoring
318
+ 2023-12-21 04:13:23,922 INFO SystemMonitor:1204 [interfaces.py:start():190] Started disk monitoring
319
+ 2023-12-21 04:13:23,923 INFO SystemMonitor:1204 [interfaces.py:start():190] Started gpu monitoring
320
+ 2023-12-21 04:13:23,924 INFO SystemMonitor:1204 [interfaces.py:start():190] Started memory monitoring
321
+ 2023-12-21 04:13:23,925 INFO SystemMonitor:1204 [interfaces.py:start():190] Started network monitoring
322
+ 2023-12-21 04:13:24,565 INFO Thread-12 :1204 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_040446-s5p2d29k/files/wandb-summary.json
323
+ 2023-12-21 04:13:27,922 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
324
+ 2023-12-21 04:13:28,008 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
325
+ 2023-12-21 04:13:32,928 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
326
+ 2023-12-21 04:13:33,014 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
327
+ 2023-12-21 04:13:33,568 INFO Thread-12 :1204 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_040446-s5p2d29k/files/config.yaml
328
+ 2023-12-21 04:13:38,014 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
329
+ 2023-12-21 04:13:38,042 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
330
+ 2023-12-21 04:13:38,064 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: partial_history
331
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
332
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
333
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
334
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: metric
335
+ 2023-12-21 04:13:38,067 DEBUG SenderThread:1204 [sender.py:send():382] send: history
336
+ 2023-12-21 04:13:38,068 DEBUG SenderThread:1204 [sender.py:send_request():409] send_request: summary_record
337
+ 2023-12-21 04:13:38,068 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: pause
338
+ 2023-12-21 04:13:38,069 INFO HandlerThread:1204 [handler.py:handle_request_pause():705] stopping system metrics thread
339
+ 2023-12-21 04:13:38,069 INFO HandlerThread:1204 [system_monitor.py:finish():203] Stopping system monitor
340
+ 2023-12-21 04:13:38,070 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined cpu monitor
341
+ 2023-12-21 04:13:38,070 DEBUG SystemMonitor:1204 [system_monitor.py:_start():172] Starting system metrics aggregation loop
342
+ 2023-12-21 04:13:38,070 INFO SenderThread:1204 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
343
+ 2023-12-21 04:13:38,073 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined disk monitor
344
+ 2023-12-21 04:13:38,073 DEBUG SystemMonitor:1204 [system_monitor.py:_start():179] Finished system metrics aggregation loop
345
+ 2023-12-21 04:13:38,074 DEBUG SystemMonitor:1204 [system_monitor.py:_start():183] Publishing last batch of metrics
346
+ 2023-12-21 04:13:38,086 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined gpu monitor
347
+ 2023-12-21 04:13:38,086 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined memory monitor
348
+ 2023-12-21 04:13:38,086 INFO HandlerThread:1204 [interfaces.py:finish():202] Joined network monitor
349
+ 2023-12-21 04:13:38,087 DEBUG SenderThread:1204 [sender.py:send():382] send: stats
350
+ 2023-12-21 04:13:38,570 INFO Thread-12 :1204 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_040446-s5p2d29k/files/wandb-summary.json
351
+ 2023-12-21 04:13:40,571 INFO Thread-12 :1204 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_040446-s5p2d29k/files/output.log
352
+ 2023-12-21 04:13:43,016 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
353
+ 2023-12-21 04:13:43,088 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
354
+ 2023-12-21 04:13:48,017 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
355
+ 2023-12-21 04:13:48,089 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
356
+ 2023-12-21 04:13:48,919 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: resume
357
+ 2023-12-21 04:13:48,920 INFO HandlerThread:1204 [handler.py:handle_request_resume():696] starting system metrics thread
358
+ 2023-12-21 04:13:48,920 INFO HandlerThread:1204 [system_monitor.py:start():194] Starting system monitor
359
+ 2023-12-21 04:13:48,920 INFO SystemMonitor:1204 [system_monitor.py:_start():158] Starting system asset monitoring threads
360
+ 2023-12-21 04:13:48,921 INFO SystemMonitor:1204 [interfaces.py:start():190] Started cpu monitoring
361
+ 2023-12-21 04:13:48,921 INFO SystemMonitor:1204 [interfaces.py:start():190] Started disk monitoring
362
+ 2023-12-21 04:13:48,922 INFO SystemMonitor:1204 [interfaces.py:start():190] Started gpu monitoring
363
+ 2023-12-21 04:13:48,923 INFO SystemMonitor:1204 [interfaces.py:start():190] Started memory monitoring
364
+ 2023-12-21 04:13:48,926 INFO SystemMonitor:1204 [interfaces.py:start():190] Started network monitoring
365
+ 2023-12-21 04:13:53,018 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
366
+ 2023-12-21 04:13:53,090 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
367
+ 2023-12-21 04:13:58,019 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: keepalive
368
+ 2023-12-21 04:13:58,091 DEBUG HandlerThread:1204 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20231221_040446-s5p2d29k/logs/debug.log CHANGED
@@ -28,3 +28,9 @@ config: {}
28
  2023-12-21 04:05:17,498 INFO MainThread:42 [wandb_run.py:_redirect():2178] Redirects installed.
29
  2023-12-21 04:05:17,499 INFO MainThread:42 [wandb_init.py:init():841] run started, returning control to user process
30
  2023-12-21 04:05:17,506 INFO MainThread:42 [wandb_run.py:_config_callback():1342] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['RobertaForMaskedLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 1, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'distilroberta-base', 'transformers_version': '4.37.0.dev0', 'model_type': 'roberta', 'vocab_size': 50265, 'hidden_size': 768, 'num_hidden_layers': 6, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.1, 'attention_probs_dropout_prob': 0.1, 'max_position_embeddings': 514, 'type_vocab_size': 1, 'initializer_range': 0.02, 'layer_norm_eps': 1e-05, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 3, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Dec21_04-04-18_c79b7fd35412', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
 
 
 
 
 
 
 
28
  2023-12-21 04:05:17,498 INFO MainThread:42 [wandb_run.py:_redirect():2178] Redirects installed.
29
  2023-12-21 04:05:17,499 INFO MainThread:42 [wandb_init.py:init():841] run started, returning control to user process
30
  2023-12-21 04:05:17,506 INFO MainThread:42 [wandb_run.py:_config_callback():1342] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['RobertaForMaskedLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 1, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'distilroberta-base', 'transformers_version': '4.37.0.dev0', 'model_type': 'roberta', 'vocab_size': 50265, 'hidden_size': 768, 'num_hidden_layers': 6, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.1, 'attention_probs_dropout_prob': 0.1, 'max_position_embeddings': 514, 'type_vocab_size': 1, 'initializer_range': 0.02, 'layer_norm_eps': 1e-05, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 3, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Dec21_04-04-18_c79b7fd35412', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
31
+ 2023-12-21 04:13:23,899 INFO MainThread:42 [jupyter.py:save_ipynb():373] not saving jupyter notebook
32
+ 2023-12-21 04:13:23,899 INFO MainThread:42 [wandb_init.py:_pause_backend():435] pausing backend
33
+ 2023-12-21 04:13:23,905 INFO MainThread:42 [wandb_init.py:_resume_backend():440] resuming backend
34
+ 2023-12-21 04:13:38,065 INFO MainThread:42 [jupyter.py:save_ipynb():373] not saving jupyter notebook
35
+ 2023-12-21 04:13:38,065 INFO MainThread:42 [wandb_init.py:_pause_backend():435] pausing backend
36
+ 2023-12-21 04:13:48,919 INFO MainThread:42 [wandb_init.py:_resume_backend():440] resuming backend
wandb/run-20231221_040446-s5p2d29k/run-s5p2d29k.wandb CHANGED
Binary files a/wandb/run-20231221_040446-s5p2d29k/run-s5p2d29k.wandb and b/wandb/run-20231221_040446-s5p2d29k/run-s5p2d29k.wandb differ