Hugging Face's logo

nornor02
/
working

Fill-Mask
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files
xet
Metrics Community
nornor02 commited on
Commit
65a4f4e
·
1 Parent(s): 276a90b

End of training

Browse files
Files changed (12) hide show
  1. README.md +1 -1
  2. model.safetensors +1 -1
  3. runs/Dec21_15-40-36_25a3f4873e1e/events.out.tfevents.1703173236.25a3f4873e1e.42.0 +2 -2
  4. runs/Dec21_15-40-36_25a3f4873e1e/events.out.tfevents.1703173775.25a3f4873e1e.42.1 +3 -0
  5. wandb/debug-internal.log +92 -0
  6. wandb/debug.log +6 -0
  7. wandb/run-20231221_154050-m3289itb/files/config.yaml +20 -0
  8. wandb/run-20231221_154050-m3289itb/files/output.log +1 -0
  9. wandb/run-20231221_154050-m3289itb/files/wandb-summary.json +1 -1
  10. wandb/run-20231221_154050-m3289itb/logs/debug-internal.log +92 -0
  11. wandb/run-20231221_154050-m3289itb/logs/debug.log +6 -0
  12. wandb/run-20231221_154050-m3289itb/run-m3289itb.wandb +0 -0
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.0049
19
 
20
  ## Model description
21
 
 
15
 
16
  This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.9990
19
 
20
  ## Model description
21
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:52cedebb0d870bbc8bae4c746d81d95eb2a2f08b5c91660f3befad7d95968b3b
3
  size 328693404
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fab18ce7cc436b4187993f2fb1b609a680acf95fe2279239892b633cfb33b3c2
3
  size 328693404
runs/Dec21_15-40-36_25a3f4873e1e/events.out.tfevents.1703173236.25a3f4873e1e.42.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd80c92cb81ff666f1a652f6218160dc890ec8f0015e34ab8dfd59e2498ee3bc
3
- size 4841
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12b3eb5c4c620e3188ec85b22b2e76167671f54570564dc2e9d7216b691e1848
3
+ size 5195
runs/Dec21_15-40-36_25a3f4873e1e/events.out.tfevents.1703173775.25a3f4873e1e.42.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8055fd9e75689de3485cbb7c6f7f0e21af2ae172a23c49be539d3ad135d856cb
3
+ size 359
wandb/debug-internal.log CHANGED
@@ -267,3 +267,95 @@
267
  2023-12-21 15:48:29,020 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
268
  2023-12-21 15:48:32,479 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
269
  2023-12-21 15:48:34,021 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
267
  2023-12-21 15:48:29,020 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
268
  2023-12-21 15:48:32,479 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
269
  2023-12-21 15:48:34,021 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
270
+ 2023-12-21 15:48:37,480 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
271
+ 2023-12-21 15:48:39,022 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
272
+ 2023-12-21 15:48:42,741 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
273
+ 2023-12-21 15:48:44,022 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
274
+ 2023-12-21 15:48:47,748 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
275
+ 2023-12-21 15:48:49,023 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
276
+ 2023-12-21 15:48:50,888 DEBUG SenderThread:833 [sender.py:send():382] send: stats
277
+ 2023-12-21 15:48:52,749 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
278
+ 2023-12-21 15:48:54,889 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
279
+ 2023-12-21 15:48:57,749 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
280
+ 2023-12-21 15:48:59,890 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
281
+ 2023-12-21 15:49:02,751 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
282
+ 2023-12-21 15:49:04,891 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
283
+ 2023-12-21 15:49:07,752 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
284
+ 2023-12-21 15:49:09,892 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
285
+ 2023-12-21 15:49:12,753 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
286
+ 2023-12-21 15:49:14,893 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
287
+ 2023-12-21 15:49:17,754 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
288
+ 2023-12-21 15:49:19,894 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
289
+ 2023-12-21 15:49:20,889 DEBUG SenderThread:833 [sender.py:send():382] send: stats
290
+ 2023-12-21 15:49:21,368 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: partial_history
291
+ 2023-12-21 15:49:21,370 DEBUG SenderThread:833 [sender.py:send():382] send: metric
292
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: metric
293
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: metric
294
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: metric
295
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: metric
296
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: history
297
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send_request():409] send_request: summary_record
298
+ 2023-12-21 15:49:21,372 INFO SenderThread:833 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
299
+ 2023-12-21 15:49:21,373 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: pause
300
+ 2023-12-21 15:49:21,374 INFO HandlerThread:833 [handler.py:handle_request_pause():705] stopping system metrics thread
301
+ 2023-12-21 15:49:21,374 INFO HandlerThread:833 [system_monitor.py:finish():203] Stopping system monitor
302
+ 2023-12-21 15:49:21,374 DEBUG SystemMonitor:833 [system_monitor.py:_start():179] Finished system metrics aggregation loop
303
+ 2023-12-21 15:49:21,374 DEBUG SystemMonitor:833 [system_monitor.py:_start():183] Publishing last batch of metrics
304
+ 2023-12-21 15:49:21,375 INFO HandlerThread:833 [interfaces.py:finish():202] Joined cpu monitor
305
+ 2023-12-21 15:49:21,376 INFO HandlerThread:833 [interfaces.py:finish():202] Joined disk monitor
306
+ 2023-12-21 15:49:21,391 INFO HandlerThread:833 [interfaces.py:finish():202] Joined gpu monitor
307
+ 2023-12-21 15:49:21,391 INFO HandlerThread:833 [interfaces.py:finish():202] Joined memory monitor
308
+ 2023-12-21 15:49:21,391 INFO HandlerThread:833 [interfaces.py:finish():202] Joined network monitor
309
+ 2023-12-21 15:49:21,391 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: resume
310
+ 2023-12-21 15:49:21,392 INFO HandlerThread:833 [handler.py:handle_request_resume():696] starting system metrics thread
311
+ 2023-12-21 15:49:21,392 INFO HandlerThread:833 [system_monitor.py:start():194] Starting system monitor
312
+ 2023-12-21 15:49:21,392 INFO SystemMonitor:833 [system_monitor.py:_start():158] Starting system asset monitoring threads
313
+ 2023-12-21 15:49:21,392 DEBUG SenderThread:833 [sender.py:send():382] send: stats
314
+ 2023-12-21 15:49:21,393 INFO SystemMonitor:833 [interfaces.py:start():190] Started cpu monitoring
315
+ 2023-12-21 15:49:21,394 INFO SystemMonitor:833 [interfaces.py:start():190] Started disk monitoring
316
+ 2023-12-21 15:49:21,394 INFO SystemMonitor:833 [interfaces.py:start():190] Started gpu monitoring
317
+ 2023-12-21 15:49:21,394 INFO SystemMonitor:833 [interfaces.py:start():190] Started memory monitoring
318
+ 2023-12-21 15:49:21,395 INFO SystemMonitor:833 [interfaces.py:start():190] Started network monitoring
319
+ 2023-12-21 15:49:21,954 INFO Thread-12 :833 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_154050-m3289itb/files/wandb-summary.json
320
+ 2023-12-21 15:49:22,755 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
321
+ 2023-12-21 15:49:25,394 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
322
+ 2023-12-21 15:49:27,756 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
323
+ 2023-12-21 15:49:30,395 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
324
+ 2023-12-21 15:49:32,765 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
325
+ 2023-12-21 15:49:35,401 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
326
+ 2023-12-21 15:49:35,566 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: partial_history
327
+ 2023-12-21 15:49:35,569 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: pause
328
+ 2023-12-21 15:49:35,569 INFO HandlerThread:833 [handler.py:handle_request_pause():705] stopping system metrics thread
329
+ 2023-12-21 15:49:35,569 INFO HandlerThread:833 [system_monitor.py:finish():203] Stopping system monitor
330
+ 2023-12-21 15:49:35,570 DEBUG SenderThread:833 [sender.py:send():382] send: metric
331
+ 2023-12-21 15:49:35,570 DEBUG SenderThread:833 [sender.py:send():382] send: metric
332
+ 2023-12-21 15:49:35,570 DEBUG SenderThread:833 [sender.py:send():382] send: metric
333
+ 2023-12-21 15:49:35,570 INFO HandlerThread:833 [interfaces.py:finish():202] Joined cpu monitor
334
+ 2023-12-21 15:49:35,570 DEBUG SystemMonitor:833 [system_monitor.py:_start():172] Starting system metrics aggregation loop
335
+ 2023-12-21 15:49:35,571 DEBUG SenderThread:833 [sender.py:send():382] send: metric
336
+ 2023-12-21 15:49:35,571 INFO HandlerThread:833 [interfaces.py:finish():202] Joined disk monitor
337
+ 2023-12-21 15:49:35,571 DEBUG SystemMonitor:833 [system_monitor.py:_start():179] Finished system metrics aggregation loop
338
+ 2023-12-21 15:49:35,572 DEBUG SystemMonitor:833 [system_monitor.py:_start():183] Publishing last batch of metrics
339
+ 2023-12-21 15:49:35,571 DEBUG SenderThread:833 [sender.py:send():382] send: history
340
+ 2023-12-21 15:49:35,573 DEBUG SenderThread:833 [sender.py:send_request():409] send_request: summary_record
341
+ 2023-12-21 15:49:35,578 INFO SenderThread:833 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
342
+ 2023-12-21 15:49:35,595 INFO HandlerThread:833 [interfaces.py:finish():202] Joined gpu monitor
343
+ 2023-12-21 15:49:35,596 INFO HandlerThread:833 [interfaces.py:finish():202] Joined memory monitor
344
+ 2023-12-21 15:49:35,596 INFO HandlerThread:833 [interfaces.py:finish():202] Joined network monitor
345
+ 2023-12-21 15:49:35,596 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: resume
346
+ 2023-12-21 15:49:35,596 INFO HandlerThread:833 [handler.py:handle_request_resume():696] starting system metrics thread
347
+ 2023-12-21 15:49:35,596 INFO HandlerThread:833 [system_monitor.py:start():194] Starting system monitor
348
+ 2023-12-21 15:49:35,597 INFO SystemMonitor:833 [system_monitor.py:_start():158] Starting system asset monitoring threads
349
+ 2023-12-21 15:49:35,597 INFO SystemMonitor:833 [interfaces.py:start():190] Started cpu monitoring
350
+ 2023-12-21 15:49:35,598 INFO SystemMonitor:833 [interfaces.py:start():190] Started disk monitoring
351
+ 2023-12-21 15:49:35,598 DEBUG SenderThread:833 [sender.py:send():382] send: stats
352
+ 2023-12-21 15:49:35,598 INFO SystemMonitor:833 [interfaces.py:start():190] Started gpu monitoring
353
+ 2023-12-21 15:49:35,600 INFO SystemMonitor:833 [interfaces.py:start():190] Started memory monitoring
354
+ 2023-12-21 15:49:35,600 INFO SystemMonitor:833 [interfaces.py:start():190] Started network monitoring
355
+ 2023-12-21 15:49:35,959 INFO Thread-12 :833 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_154050-m3289itb/files/config.yaml
356
+ 2023-12-21 15:49:35,959 INFO Thread-12 :833 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_154050-m3289itb/files/wandb-summary.json
357
+ 2023-12-21 15:49:37,832 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
358
+ 2023-12-21 15:49:37,960 INFO Thread-12 :833 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_154050-m3289itb/files/output.log
359
+ 2023-12-21 15:49:40,599 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
360
+ 2023-12-21 15:49:42,833 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
361
+ 2023-12-21 15:49:45,600 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
wandb/debug.log CHANGED
@@ -28,3 +28,9 @@ config: {}
28
  2023-12-21 15:41:20,888 INFO MainThread:42 [wandb_run.py:_redirect():2178] Redirects installed.
29
  2023-12-21 15:41:20,890 INFO MainThread:42 [wandb_init.py:init():841] run started, returning control to user process
30
  2023-12-21 15:41:20,895 INFO MainThread:42 [wandb_run.py:_config_callback():1342] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['RobertaForMaskedLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 1, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'distilroberta-base', 'transformers_version': '4.37.0.dev0', 'model_type': 'roberta', 'vocab_size': 50265, 'hidden_size': 768, 'num_hidden_layers': 6, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.1, 'attention_probs_dropout_prob': 0.1, 'max_position_embeddings': 514, 'type_vocab_size': 1, 'initializer_range': 0.02, 'layer_norm_eps': 1e-05, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 3, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Dec21_15-40-36_25a3f4873e1e', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
 
 
 
 
 
 
 
28
  2023-12-21 15:41:20,888 INFO MainThread:42 [wandb_run.py:_redirect():2178] Redirects installed.
29
  2023-12-21 15:41:20,890 INFO MainThread:42 [wandb_init.py:init():841] run started, returning control to user process
30
  2023-12-21 15:41:20,895 INFO MainThread:42 [wandb_run.py:_config_callback():1342] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['RobertaForMaskedLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 1, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'distilroberta-base', 'transformers_version': '4.37.0.dev0', 'model_type': 'roberta', 'vocab_size': 50265, 'hidden_size': 768, 'num_hidden_layers': 6, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.1, 'attention_probs_dropout_prob': 0.1, 'max_position_embeddings': 514, 'type_vocab_size': 1, 'initializer_range': 0.02, 'layer_norm_eps': 1e-05, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 3, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Dec21_15-40-36_25a3f4873e1e', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
31
+ 2023-12-21 15:49:21,373 INFO MainThread:42 [jupyter.py:save_ipynb():373] not saving jupyter notebook
32
+ 2023-12-21 15:49:21,373 INFO MainThread:42 [wandb_init.py:_pause_backend():435] pausing backend
33
+ 2023-12-21 15:49:21,379 INFO MainThread:42 [wandb_init.py:_resume_backend():440] resuming backend
34
+ 2023-12-21 15:49:35,567 INFO MainThread:42 [jupyter.py:save_ipynb():373] not saving jupyter notebook
35
+ 2023-12-21 15:49:35,567 INFO MainThread:42 [wandb_init.py:_pause_backend():435] pausing backend
36
+ 2023-12-21 15:49:35,573 INFO MainThread:42 [wandb_init.py:_resume_backend():440] resuming backend
wandb/run-20231221_154050-m3289itb/files/config.yaml CHANGED
@@ -66,6 +66,26 @@ _wandb:
66
  5: 1
67
  6:
68
  - 1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69
  return_dict:
70
  desc: null
71
  value: true
 
66
  5: 1
67
  6:
68
  - 1
69
+ - 1: train/train_runtime
70
+ 5: 1
71
+ 6:
72
+ - 1
73
+ - 1: train/train_samples_per_second
74
+ 5: 1
75
+ 6:
76
+ - 1
77
+ - 1: train/train_steps_per_second
78
+ 5: 1
79
+ 6:
80
+ - 1
81
+ - 1: train/total_flos
82
+ 5: 1
83
+ 6:
84
+ - 1
85
+ - 1: train/train_loss
86
+ 5: 1
87
+ 6:
88
+ - 1
89
  return_dict:
90
  desc: null
91
  value: true
wandb/run-20231221_154050-m3289itb/files/output.log CHANGED
@@ -6,3 +6,4 @@ You're using a RobertaTokenizerFast tokenizer. Please note that with a fast toke
6
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
7
  warnings.warn('Was asked to gather along dimension 0, but all '
8
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
 
 
6
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
7
  warnings.warn('Was asked to gather along dimension 0, but all '
8
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
9
+ warnings.warn('Was asked to gather along dimension 0, but all '
wandb/run-20231221_154050-m3289itb/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 2.1452, "train/learning_rate": 2.4868651488616464e-06, "train/epoch": 2.63, "train/global_step": 1500, "_timestamp": 1703173700.194624, "_runtime": 450.0790548324585, "_step": 2}
 
1
+ {"train/loss": 2.1452, "train/learning_rate": 2.4868651488616464e-06, "train/epoch": 3.0, "train/global_step": 1713, "_timestamp": 1703173775.5664046, "_runtime": 525.4508354663849, "_step": 4, "train/train_runtime": 524.6089, "train/train_samples_per_second": 52.227, "train/train_steps_per_second": 3.265, "train/total_flos": 908426219703552.0, "train/train_loss": 2.203427610380637, "eval/loss": 1.998970627784729, "eval/runtime": 14.1784, "eval/samples_per_second": 156.647, "eval/steps_per_second": 9.804}
wandb/run-20231221_154050-m3289itb/logs/debug-internal.log CHANGED
@@ -267,3 +267,95 @@
267
  2023-12-21 15:48:29,020 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
268
  2023-12-21 15:48:32,479 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
269
  2023-12-21 15:48:34,021 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
267
  2023-12-21 15:48:29,020 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
268
  2023-12-21 15:48:32,479 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
269
  2023-12-21 15:48:34,021 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
270
+ 2023-12-21 15:48:37,480 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
271
+ 2023-12-21 15:48:39,022 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
272
+ 2023-12-21 15:48:42,741 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
273
+ 2023-12-21 15:48:44,022 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
274
+ 2023-12-21 15:48:47,748 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
275
+ 2023-12-21 15:48:49,023 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
276
+ 2023-12-21 15:48:50,888 DEBUG SenderThread:833 [sender.py:send():382] send: stats
277
+ 2023-12-21 15:48:52,749 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
278
+ 2023-12-21 15:48:54,889 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
279
+ 2023-12-21 15:48:57,749 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
280
+ 2023-12-21 15:48:59,890 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
281
+ 2023-12-21 15:49:02,751 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
282
+ 2023-12-21 15:49:04,891 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
283
+ 2023-12-21 15:49:07,752 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
284
+ 2023-12-21 15:49:09,892 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
285
+ 2023-12-21 15:49:12,753 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
286
+ 2023-12-21 15:49:14,893 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
287
+ 2023-12-21 15:49:17,754 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
288
+ 2023-12-21 15:49:19,894 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
289
+ 2023-12-21 15:49:20,889 DEBUG SenderThread:833 [sender.py:send():382] send: stats
290
+ 2023-12-21 15:49:21,368 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: partial_history
291
+ 2023-12-21 15:49:21,370 DEBUG SenderThread:833 [sender.py:send():382] send: metric
292
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: metric
293
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: metric
294
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: metric
295
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: metric
296
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send():382] send: history
297
+ 2023-12-21 15:49:21,371 DEBUG SenderThread:833 [sender.py:send_request():409] send_request: summary_record
298
+ 2023-12-21 15:49:21,372 INFO SenderThread:833 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
299
+ 2023-12-21 15:49:21,373 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: pause
300
+ 2023-12-21 15:49:21,374 INFO HandlerThread:833 [handler.py:handle_request_pause():705] stopping system metrics thread
301
+ 2023-12-21 15:49:21,374 INFO HandlerThread:833 [system_monitor.py:finish():203] Stopping system monitor
302
+ 2023-12-21 15:49:21,374 DEBUG SystemMonitor:833 [system_monitor.py:_start():179] Finished system metrics aggregation loop
303
+ 2023-12-21 15:49:21,374 DEBUG SystemMonitor:833 [system_monitor.py:_start():183] Publishing last batch of metrics
304
+ 2023-12-21 15:49:21,375 INFO HandlerThread:833 [interfaces.py:finish():202] Joined cpu monitor
305
+ 2023-12-21 15:49:21,376 INFO HandlerThread:833 [interfaces.py:finish():202] Joined disk monitor
306
+ 2023-12-21 15:49:21,391 INFO HandlerThread:833 [interfaces.py:finish():202] Joined gpu monitor
307
+ 2023-12-21 15:49:21,391 INFO HandlerThread:833 [interfaces.py:finish():202] Joined memory monitor
308
+ 2023-12-21 15:49:21,391 INFO HandlerThread:833 [interfaces.py:finish():202] Joined network monitor
309
+ 2023-12-21 15:49:21,391 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: resume
310
+ 2023-12-21 15:49:21,392 INFO HandlerThread:833 [handler.py:handle_request_resume():696] starting system metrics thread
311
+ 2023-12-21 15:49:21,392 INFO HandlerThread:833 [system_monitor.py:start():194] Starting system monitor
312
+ 2023-12-21 15:49:21,392 INFO SystemMonitor:833 [system_monitor.py:_start():158] Starting system asset monitoring threads
313
+ 2023-12-21 15:49:21,392 DEBUG SenderThread:833 [sender.py:send():382] send: stats
314
+ 2023-12-21 15:49:21,393 INFO SystemMonitor:833 [interfaces.py:start():190] Started cpu monitoring
315
+ 2023-12-21 15:49:21,394 INFO SystemMonitor:833 [interfaces.py:start():190] Started disk monitoring
316
+ 2023-12-21 15:49:21,394 INFO SystemMonitor:833 [interfaces.py:start():190] Started gpu monitoring
317
+ 2023-12-21 15:49:21,394 INFO SystemMonitor:833 [interfaces.py:start():190] Started memory monitoring
318
+ 2023-12-21 15:49:21,395 INFO SystemMonitor:833 [interfaces.py:start():190] Started network monitoring
319
+ 2023-12-21 15:49:21,954 INFO Thread-12 :833 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_154050-m3289itb/files/wandb-summary.json
320
+ 2023-12-21 15:49:22,755 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
321
+ 2023-12-21 15:49:25,394 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
322
+ 2023-12-21 15:49:27,756 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
323
+ 2023-12-21 15:49:30,395 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
324
+ 2023-12-21 15:49:32,765 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
325
+ 2023-12-21 15:49:35,401 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
326
+ 2023-12-21 15:49:35,566 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: partial_history
327
+ 2023-12-21 15:49:35,569 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: pause
328
+ 2023-12-21 15:49:35,569 INFO HandlerThread:833 [handler.py:handle_request_pause():705] stopping system metrics thread
329
+ 2023-12-21 15:49:35,569 INFO HandlerThread:833 [system_monitor.py:finish():203] Stopping system monitor
330
+ 2023-12-21 15:49:35,570 DEBUG SenderThread:833 [sender.py:send():382] send: metric
331
+ 2023-12-21 15:49:35,570 DEBUG SenderThread:833 [sender.py:send():382] send: metric
332
+ 2023-12-21 15:49:35,570 DEBUG SenderThread:833 [sender.py:send():382] send: metric
333
+ 2023-12-21 15:49:35,570 INFO HandlerThread:833 [interfaces.py:finish():202] Joined cpu monitor
334
+ 2023-12-21 15:49:35,570 DEBUG SystemMonitor:833 [system_monitor.py:_start():172] Starting system metrics aggregation loop
335
+ 2023-12-21 15:49:35,571 DEBUG SenderThread:833 [sender.py:send():382] send: metric
336
+ 2023-12-21 15:49:35,571 INFO HandlerThread:833 [interfaces.py:finish():202] Joined disk monitor
337
+ 2023-12-21 15:49:35,571 DEBUG SystemMonitor:833 [system_monitor.py:_start():179] Finished system metrics aggregation loop
338
+ 2023-12-21 15:49:35,572 DEBUG SystemMonitor:833 [system_monitor.py:_start():183] Publishing last batch of metrics
339
+ 2023-12-21 15:49:35,571 DEBUG SenderThread:833 [sender.py:send():382] send: history
340
+ 2023-12-21 15:49:35,573 DEBUG SenderThread:833 [sender.py:send_request():409] send_request: summary_record
341
+ 2023-12-21 15:49:35,578 INFO SenderThread:833 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
342
+ 2023-12-21 15:49:35,595 INFO HandlerThread:833 [interfaces.py:finish():202] Joined gpu monitor
343
+ 2023-12-21 15:49:35,596 INFO HandlerThread:833 [interfaces.py:finish():202] Joined memory monitor
344
+ 2023-12-21 15:49:35,596 INFO HandlerThread:833 [interfaces.py:finish():202] Joined network monitor
345
+ 2023-12-21 15:49:35,596 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: resume
346
+ 2023-12-21 15:49:35,596 INFO HandlerThread:833 [handler.py:handle_request_resume():696] starting system metrics thread
347
+ 2023-12-21 15:49:35,596 INFO HandlerThread:833 [system_monitor.py:start():194] Starting system monitor
348
+ 2023-12-21 15:49:35,597 INFO SystemMonitor:833 [system_monitor.py:_start():158] Starting system asset monitoring threads
349
+ 2023-12-21 15:49:35,597 INFO SystemMonitor:833 [interfaces.py:start():190] Started cpu monitoring
350
+ 2023-12-21 15:49:35,598 INFO SystemMonitor:833 [interfaces.py:start():190] Started disk monitoring
351
+ 2023-12-21 15:49:35,598 DEBUG SenderThread:833 [sender.py:send():382] send: stats
352
+ 2023-12-21 15:49:35,598 INFO SystemMonitor:833 [interfaces.py:start():190] Started gpu monitoring
353
+ 2023-12-21 15:49:35,600 INFO SystemMonitor:833 [interfaces.py:start():190] Started memory monitoring
354
+ 2023-12-21 15:49:35,600 INFO SystemMonitor:833 [interfaces.py:start():190] Started network monitoring
355
+ 2023-12-21 15:49:35,959 INFO Thread-12 :833 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_154050-m3289itb/files/config.yaml
356
+ 2023-12-21 15:49:35,959 INFO Thread-12 :833 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_154050-m3289itb/files/wandb-summary.json
357
+ 2023-12-21 15:49:37,832 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
358
+ 2023-12-21 15:49:37,960 INFO Thread-12 :833 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231221_154050-m3289itb/files/output.log
359
+ 2023-12-21 15:49:40,599 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
360
+ 2023-12-21 15:49:42,833 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: keepalive
361
+ 2023-12-21 15:49:45,600 DEBUG HandlerThread:833 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20231221_154050-m3289itb/logs/debug.log CHANGED
@@ -28,3 +28,9 @@ config: {}
28
  2023-12-21 15:41:20,888 INFO MainThread:42 [wandb_run.py:_redirect():2178] Redirects installed.
29
  2023-12-21 15:41:20,890 INFO MainThread:42 [wandb_init.py:init():841] run started, returning control to user process
30
  2023-12-21 15:41:20,895 INFO MainThread:42 [wandb_run.py:_config_callback():1342] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['RobertaForMaskedLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 1, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'distilroberta-base', 'transformers_version': '4.37.0.dev0', 'model_type': 'roberta', 'vocab_size': 50265, 'hidden_size': 768, 'num_hidden_layers': 6, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.1, 'attention_probs_dropout_prob': 0.1, 'max_position_embeddings': 514, 'type_vocab_size': 1, 'initializer_range': 0.02, 'layer_norm_eps': 1e-05, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 3, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Dec21_15-40-36_25a3f4873e1e', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
 
 
 
 
 
 
 
28
  2023-12-21 15:41:20,888 INFO MainThread:42 [wandb_run.py:_redirect():2178] Redirects installed.
29
  2023-12-21 15:41:20,890 INFO MainThread:42 [wandb_init.py:init():841] run started, returning control to user process
30
  2023-12-21 15:41:20,895 INFO MainThread:42 [wandb_run.py:_config_callback():1342] config_cb None None {'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': None, 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'chunk_size_feed_forward': 0, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['RobertaForMaskedLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 0, 'pad_token_id': 1, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'distilroberta-base', 'transformers_version': '4.37.0.dev0', 'model_type': 'roberta', 'vocab_size': 50265, 'hidden_size': 768, 'num_hidden_layers': 6, 'num_attention_heads': 12, 'hidden_act': 'gelu', 'intermediate_size': 3072, 'hidden_dropout_prob': 0.1, 'attention_probs_dropout_prob': 0.1, 'max_position_embeddings': 514, 'type_vocab_size': 1, 'initializer_range': 0.02, 'layer_norm_eps': 1e-05, 'position_embedding_type': 'absolute', 'use_cache': True, 'classifier_dropout': None, 'output_dir': '/kaggle/working/', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 8, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 3, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Dec21_15-40-36_25a3f4873e1e', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working/', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
31
+ 2023-12-21 15:49:21,373 INFO MainThread:42 [jupyter.py:save_ipynb():373] not saving jupyter notebook
32
+ 2023-12-21 15:49:21,373 INFO MainThread:42 [wandb_init.py:_pause_backend():435] pausing backend
33
+ 2023-12-21 15:49:21,379 INFO MainThread:42 [wandb_init.py:_resume_backend():440] resuming backend
34
+ 2023-12-21 15:49:35,567 INFO MainThread:42 [jupyter.py:save_ipynb():373] not saving jupyter notebook
35
+ 2023-12-21 15:49:35,567 INFO MainThread:42 [wandb_init.py:_pause_backend():435] pausing backend
36
+ 2023-12-21 15:49:35,573 INFO MainThread:42 [wandb_init.py:_resume_backend():440] resuming backend
wandb/run-20231221_154050-m3289itb/run-m3289itb.wandb CHANGED
Binary files a/wandb/run-20231221_154050-m3289itb/run-m3289itb.wandb and b/wandb/run-20231221_154050-m3289itb/run-m3289itb.wandb differ