Hugging Face's logo

Svangorden13
/
working

Token Classification
Transformers
TensorBoard
Safetensors
distilbert
Model card Files
xet
Metrics Community
Svangorden13 commited on
Commit
cc2e7d0
·
verified ·
1 Parent(s): 5a8e865

Training in progress, epoch 1

Browse files
Files changed (11) hide show
  1. model.safetensors +1 -1
  2. runs/Feb27_19-41-09_fcc1160403f2/events.out.tfevents.1709062874.fcc1160403f2.345.1 +3 -0
  3. training_args.bin +1 -1
  4. wandb/debug-internal.log +0 -0
  5. wandb/debug.log +85 -0
  6. wandb/run-20240227_190534-i3bofc05/files/config.yaml +61 -1
  7. wandb/run-20240227_190534-i3bofc05/files/output.log +63 -0
  8. wandb/run-20240227_190534-i3bofc05/files/wandb-summary.json +1 -1
  9. wandb/run-20240227_190534-i3bofc05/logs/debug-internal.log +0 -0
  10. wandb/run-20240227_190534-i3bofc05/logs/debug.log +85 -0
  11. wandb/run-20240227_190534-i3bofc05/run-i3bofc05.wandb +0 -0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6ec28ec6e70c4cdcc451f95a910a021ab43f84f207eb36fcf8ef654170178ac5
3
  size 265503852
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c1bf8bb2ef4d649d80f222eea16794172638e52a6ef7c95799ee7794987859c
3
  size 265503852
runs/Feb27_19-41-09_fcc1160403f2/events.out.tfevents.1709062874.fcc1160403f2.345.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b7e0dd87635d26dd0a749f62bedfe6fba54fa4b1fdf99228c1a1899577663aa
3
+ size 5708
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2709d3897ff844d88e5bd94ea3a4b61f67ba688234e0ee65c92ca8f2cc04345d
3
  size 4728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9cacd27ca9f0b4dc48af114f6d35364761d6d40462bfdece1d52600c1a33986
3
  size 4728
wandb/debug-internal.log CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/debug.log CHANGED
@@ -29,3 +29,88 @@ config: {}
29
  2024-02-27 19:06:05,430 INFO MainThread:345 [wandb_run.py:_redirect():2178] Redirects installed.
30
  2024-02-27 19:06:05,431 INFO MainThread:345 [wandb_init.py:init():847] run started, returning control to user process
31
  2024-02-27 19:06:05,437 INFO MainThread:345 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 30522, 'max_position_embeddings': 512, 'sinusoidal_pos_embds': False, 'n_layers': 6, 'n_heads': 12, 'dim': 768, 'hidden_dim': 3072, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation': 'gelu', 'initializer_range': 0.02, 'qa_dropout': 0.1, 'seq_classif_dropout': 0.2, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['DistilBertForTokenClassification'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2', 3: 'LABEL_3', 4: 'LABEL_4', 5: 'LABEL_5', 6: 'LABEL_6', 7: 'LABEL_7', 8: 'LABEL_8', 9: 'LABEL_9', 10: 'LABEL_10', 11: 'LABEL_11', 12: 'LABEL_12'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2, 'LABEL_3': 3, 'LABEL_4': 4, 'LABEL_5': 5, 'LABEL_6': 6, 'LABEL_7': 7, 'LABEL_8': 8, 'LABEL_9': 9, 'LABEL_10': 10, 'LABEL_11': 11, 'LABEL_12': 12}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'malduwais/distilbert-base-uncased-finetuned-ner', 'transformers_version': '4.37.0', 'model_type': 'distilbert', 'tie_weights_': True, 'output_dir': '/kaggle/working', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb27_19-05-30_fcc1160403f2', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'loss', 'greater_is_better': False, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  2024-02-27 19:06:05,430 INFO MainThread:345 [wandb_run.py:_redirect():2178] Redirects installed.
30
  2024-02-27 19:06:05,431 INFO MainThread:345 [wandb_init.py:init():847] run started, returning control to user process
31
  2024-02-27 19:06:05,437 INFO MainThread:345 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 30522, 'max_position_embeddings': 512, 'sinusoidal_pos_embds': False, 'n_layers': 6, 'n_heads': 12, 'dim': 768, 'hidden_dim': 3072, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation': 'gelu', 'initializer_range': 0.02, 'qa_dropout': 0.1, 'seq_classif_dropout': 0.2, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['DistilBertForTokenClassification'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2', 3: 'LABEL_3', 4: 'LABEL_4', 5: 'LABEL_5', 6: 'LABEL_6', 7: 'LABEL_7', 8: 'LABEL_8', 9: 'LABEL_9', 10: 'LABEL_10', 11: 'LABEL_11', 12: 'LABEL_12'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2, 'LABEL_3': 3, 'LABEL_4': 4, 'LABEL_5': 5, 'LABEL_6': 6, 'LABEL_7': 7, 'LABEL_8': 8, 'LABEL_9': 9, 'LABEL_10': 10, 'LABEL_11': 11, 'LABEL_12': 12}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'malduwais/distilbert-base-uncased-finetuned-ner', 'transformers_version': '4.37.0', 'model_type': 'distilbert', 'tie_weights_': True, 'output_dir': '/kaggle/working', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb27_19-05-30_fcc1160403f2', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'loss', 'greater_is_better': False, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
32
+ 2024-02-27 19:09:05,083 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
33
+ 2024-02-27 19:09:05,083 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
34
+ 2024-02-27 19:09:05,089 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
35
+ 2024-02-27 19:09:05,285 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
36
+ 2024-02-27 19:09:05,285 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
37
+ 2024-02-27 19:09:05,290 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
38
+ 2024-02-27 19:09:05,294 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
39
+ 2024-02-27 19:09:05,295 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
40
+ 2024-02-27 19:09:05,301 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
41
+ 2024-02-27 19:09:05,468 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
42
+ 2024-02-27 19:09:05,468 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
43
+ 2024-02-27 19:09:05,474 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
44
+ 2024-02-27 19:09:06,899 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
45
+ 2024-02-27 19:09:06,899 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
46
+ 2024-02-27 19:22:51,710 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
47
+ 2024-02-27 19:22:51,754 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
48
+ 2024-02-27 19:22:51,754 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
49
+ 2024-02-27 19:22:59,838 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
50
+ 2024-02-27 19:22:59,851 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
51
+ 2024-02-27 19:22:59,852 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
52
+ 2024-02-27 19:23:12,301 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
53
+ 2024-02-27 19:23:12,414 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
54
+ 2024-02-27 19:23:12,414 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
55
+ 2024-02-27 19:23:31,995 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
56
+ 2024-02-27 19:23:43,602 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
57
+ 2024-02-27 19:23:43,603 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
58
+ 2024-02-27 19:39:48,403 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
59
+ 2024-02-27 19:40:25,322 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
60
+ 2024-02-27 19:40:25,322 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
61
+ 2024-02-27 19:40:25,330 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
62
+ 2024-02-27 19:40:25,331 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
63
+ 2024-02-27 19:40:25,332 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
64
+ 2024-02-27 19:40:25,340 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
65
+ 2024-02-27 19:40:27,057 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
66
+ 2024-02-27 19:40:27,057 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
67
+ 2024-02-27 19:40:27,064 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
68
+ 2024-02-27 19:40:27,195 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
69
+ 2024-02-27 19:40:27,195 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
70
+ 2024-02-27 19:40:27,202 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
71
+ 2024-02-27 19:40:27,817 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
72
+ 2024-02-27 19:40:27,817 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
73
+ 2024-02-27 19:40:27,824 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
74
+ 2024-02-27 19:40:33,665 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
75
+ 2024-02-27 19:40:33,666 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
76
+ 2024-02-27 19:40:33,676 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
77
+ 2024-02-27 19:40:33,678 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
78
+ 2024-02-27 19:40:33,678 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
79
+ 2024-02-27 19:40:33,685 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
80
+ 2024-02-27 19:40:40,172 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
81
+ 2024-02-27 19:40:40,172 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
82
+ 2024-02-27 19:40:40,179 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
83
+ 2024-02-27 19:41:07,056 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
84
+ 2024-02-27 19:41:07,056 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
85
+ 2024-02-27 19:41:07,065 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
86
+ 2024-02-27 19:41:07,102 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
87
+ 2024-02-27 19:41:07,102 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
88
+ 2024-02-27 19:41:07,108 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
89
+ 2024-02-27 19:41:07,119 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
90
+ 2024-02-27 19:41:07,119 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
91
+ 2024-02-27 19:41:07,127 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
92
+ 2024-02-27 19:41:07,957 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
93
+ 2024-02-27 19:41:07,958 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
94
+ 2024-02-27 19:41:07,963 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
95
+ 2024-02-27 19:41:08,494 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
96
+ 2024-02-27 19:41:08,494 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
97
+ 2024-02-27 19:41:08,504 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
98
+ 2024-02-27 19:41:08,507 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
99
+ 2024-02-27 19:41:08,507 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
100
+ 2024-02-27 19:41:08,515 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
101
+ 2024-02-27 19:41:08,726 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
102
+ 2024-02-27 19:41:08,726 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
103
+ 2024-02-27 19:41:08,732 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
104
+ 2024-02-27 19:41:08,733 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
105
+ 2024-02-27 19:41:08,733 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
106
+ 2024-02-27 19:41:08,739 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
107
+ 2024-02-27 19:41:09,530 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
108
+ 2024-02-27 19:41:09,530 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
109
+ 2024-02-27 19:41:09,539 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
110
+ 2024-02-27 19:41:09,541 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
111
+ 2024-02-27 19:41:09,541 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
112
+ 2024-02-27 19:41:09,548 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
113
+ 2024-02-27 19:41:09,556 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
114
+ 2024-02-27 19:41:09,557 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
115
+ 2024-02-27 19:41:09,564 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
116
+ 2024-02-27 19:41:14,793 INFO MainThread:345 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 30522, 'max_position_embeddings': 512, 'sinusoidal_pos_embds': False, 'n_layers': 6, 'n_heads': 12, 'dim': 768, 'hidden_dim': 3072, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation': 'gelu', 'initializer_range': 0.02, 'qa_dropout': 0.1, 'seq_classif_dropout': 0.2, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['DistilBertForTokenClassification'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2', 3: 'LABEL_3', 4: 'LABEL_4', 5: 'LABEL_5', 6: 'LABEL_6', 7: 'LABEL_7', 8: 'LABEL_8', 9: 'LABEL_9', 10: 'LABEL_10', 11: 'LABEL_11', 12: 'LABEL_12'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2, 'LABEL_3': 3, 'LABEL_4': 4, 'LABEL_5': 5, 'LABEL_6': 6, 'LABEL_7': 7, 'LABEL_8': 8, 'LABEL_9': 9, 'LABEL_10': 10, 'LABEL_11': 11, 'LABEL_12': 12}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'malduwais/distilbert-base-uncased-finetuned-ner', 'transformers_version': '4.37.0', 'model_type': 'distilbert', 'tie_weights_': True, 'output_dir': '/kaggle/working', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb27_19-41-09_fcc1160403f2', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'loss', 'greater_is_better': False, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
wandb/run-20240227_190534-i3bofc05/files/config.yaml CHANGED
@@ -56,6 +56,66 @@ _wandb:
56
  - 1: train/global_step
57
  6:
58
  - 3
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
59
  vocab_size:
60
  desc: null
61
  value: 30522
@@ -382,7 +442,7 @@ log_on_each_node:
382
  value: true
383
  logging_dir:
384
  desc: null
385
- value: /kaggle/working/runs/Feb27_19-05-30_fcc1160403f2
386
  logging_strategy:
387
  desc: null
388
  value: steps
 
56
  - 1: train/global_step
57
  6:
58
  - 3
59
+ - 1: eval/loss
60
+ 5: 1
61
+ 6:
62
+ - 1
63
+ - 1: eval/precision
64
+ 5: 1
65
+ 6:
66
+ - 1
67
+ - 1: eval/recall
68
+ 5: 1
69
+ 6:
70
+ - 1
71
+ - 1: eval/f1
72
+ 5: 1
73
+ 6:
74
+ - 1
75
+ - 1: eval/accuracy
76
+ 5: 1
77
+ 6:
78
+ - 1
79
+ - 1: eval/f5
80
+ 5: 1
81
+ 6:
82
+ - 1
83
+ - 1: eval/runtime
84
+ 5: 1
85
+ 6:
86
+ - 1
87
+ - 1: eval/samples_per_second
88
+ 5: 1
89
+ 6:
90
+ - 1
91
+ - 1: eval/steps_per_second
92
+ 5: 1
93
+ 6:
94
+ - 1
95
+ - 1: train/epoch
96
+ 5: 1
97
+ 6:
98
+ - 1
99
+ - 1: train/train_runtime
100
+ 5: 1
101
+ 6:
102
+ - 1
103
+ - 1: train/train_samples_per_second
104
+ 5: 1
105
+ 6:
106
+ - 1
107
+ - 1: train/train_steps_per_second
108
+ 5: 1
109
+ 6:
110
+ - 1
111
+ - 1: train/total_flos
112
+ 5: 1
113
+ 6:
114
+ - 1
115
+ - 1: train/train_loss
116
+ 5: 1
117
+ 6:
118
+ - 1
119
  vocab_size:
120
  desc: null
121
  value: 30522
 
442
  value: true
443
  logging_dir:
444
  desc: null
445
+ value: /kaggle/working/runs/Feb27_19-41-09_fcc1160403f2
446
  logging_strategy:
447
  desc: null
448
  value: steps
wandb/run-20240227_190534-i3bofc05/files/output.log CHANGED
@@ -1 +1,64 @@
1
  /opt/conda/lib/python3.10/site-packages/seqeval/metrics/v1.py:57: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  /opt/conda/lib/python3.10/site-packages/seqeval/metrics/v1.py:57: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
2
+ _warn_prf(average, modifier, msg_start, len(result))
3
+ Requirement already satisfied: evaluate in /opt/conda/lib/python3.10/site-packages (0.4.1)
4
+ Requirement already satisfied: datasets>=2.0.0 in /opt/conda/lib/python3.10/site-packages (from evaluate) (2.1.0)
5
+ Requirement already satisfied: numpy>=1.17 in /opt/conda/lib/python3.10/site-packages (from evaluate) (1.24.4)
6
+ Requirement already satisfied: dill in /opt/conda/lib/python3.10/site-packages (from evaluate) (0.3.7)
7
+ Requirement already satisfied: pandas in /opt/conda/lib/python3.10/site-packages (from evaluate) (2.1.4)
8
+ Requirement already satisfied: requests>=2.19.0 in /opt/conda/lib/python3.10/site-packages (from evaluate) (2.31.0)
9
+ Requirement already satisfied: tqdm>=4.62.1 in /opt/conda/lib/python3.10/site-packages (from evaluate) (4.66.1)
10
+ Requirement already satisfied: xxhash in /opt/conda/lib/python3.10/site-packages (from evaluate) (3.4.1)
11
+ Requirement already satisfied: multiprocess in /opt/conda/lib/python3.10/site-packages (from evaluate) (0.70.15)
12
+ Requirement already satisfied: fsspec>=2021.05.0 in /opt/conda/lib/python3.10/site-packages (from fsspec[http]>=2021.05.0->evaluate) (2023.12.2)
13
+ Requirement already satisfied: huggingface-hub>=0.7.0 in /opt/conda/lib/python3.10/site-packages (from evaluate) (0.20.3)
14
+ Requirement already satisfied: packaging in /opt/conda/lib/python3.10/site-packages (from evaluate) (21.3)
15
+ Requirement already satisfied: responses<0.19 in /opt/conda/lib/python3.10/site-packages (from evaluate) (0.18.0)
16
+ Requirement already satisfied: pyarrow>=5.0.0 in /opt/conda/lib/python3.10/site-packages (from datasets>=2.0.0->evaluate) (11.0.0)
17
+ Requirement already satisfied: aiohttp in /opt/conda/lib/python3.10/site-packages (from datasets>=2.0.0->evaluate) (3.9.1)
18
+ Requirement already satisfied: filelock in /opt/conda/lib/python3.10/site-packages (from huggingface-hub>=0.7.0->evaluate) (3.13.1)
19
+ Requirement already satisfied: pyyaml>=5.1 in /opt/conda/lib/python3.10/site-packages (from huggingface-hub>=0.7.0->evaluate) (6.0.1)
20
+ Requirement already satisfied: typing-extensions>=3.7.4.3 in /opt/conda/lib/python3.10/site-packages (from huggingface-hub>=0.7.0->evaluate) (4.9.0)
21
+ Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /opt/conda/lib/python3.10/site-packages (from packaging->evaluate) (3.1.1)
22
+ Requirement already satisfied: charset-normalizer<4,>=2 in /opt/conda/lib/python3.10/site-packages (from requests>=2.19.0->evaluate) (3.3.2)
23
+ Requirement already satisfied: idna<4,>=2.5 in /opt/conda/lib/python3.10/site-packages (from requests>=2.19.0->evaluate) (3.6)
24
+ Requirement already satisfied: urllib3<3,>=1.21.1 in /opt/conda/lib/python3.10/site-packages (from requests>=2.19.0->evaluate) (1.26.18)
25
+ Requirement already satisfied: certifi>=2017.4.17 in /opt/conda/lib/python3.10/site-packages (from requests>=2.19.0->evaluate) (2023.11.17)
26
+ Requirement already satisfied: python-dateutil>=2.8.2 in /opt/conda/lib/python3.10/site-packages (from pandas->evaluate) (2.8.2)
27
+ Requirement already satisfied: pytz>=2020.1 in /opt/conda/lib/python3.10/site-packages (from pandas->evaluate) (2023.3.post1)
28
+ Requirement already satisfied: tzdata>=2022.1 in /opt/conda/lib/python3.10/site-packages (from pandas->evaluate) (2023.4)
29
+ Requirement already satisfied: attrs>=17.3.0 in /opt/conda/lib/python3.10/site-packages (from aiohttp->datasets>=2.0.0->evaluate) (23.2.0)
30
+ Requirement already satisfied: multidict<7.0,>=4.5 in /opt/conda/lib/python3.10/site-packages (from aiohttp->datasets>=2.0.0->evaluate) (6.0.4)
31
+ Requirement already satisfied: yarl<2.0,>=1.0 in /opt/conda/lib/python3.10/site-packages (from aiohttp->datasets>=2.0.0->evaluate) (1.9.3)
32
+ Requirement already satisfied: frozenlist>=1.1.1 in /opt/conda/lib/python3.10/site-packages (from aiohttp->datasets>=2.0.0->evaluate) (1.4.1)
33
+ Requirement already satisfied: aiosignal>=1.1.2 in /opt/conda/lib/python3.10/site-packages (from aiohttp->datasets>=2.0.0->evaluate) (1.3.1)
34
+ Requirement already satisfied: async-timeout<5.0,>=4.0 in /opt/conda/lib/python3.10/site-packages (from aiohttp->datasets>=2.0.0->evaluate) (4.0.3)
35
+ Requirement already satisfied: six>=1.5 in /opt/conda/lib/python3.10/site-packages (from python-dateutil>=2.8.2->pandas->evaluate) (1.16.0)
36
+ Requirement already satisfied: seqeval in /opt/conda/lib/python3.10/site-packages (1.2.2)
37
+ Requirement already satisfied: numpy>=1.14.0 in /opt/conda/lib/python3.10/site-packages (from seqeval) (1.24.4)
38
+ Requirement already satisfied: scikit-learn>=0.21.3 in /opt/conda/lib/python3.10/site-packages (from seqeval) (1.2.2)
39
+ Requirement already satisfied: scipy>=1.3.2 in /opt/conda/lib/python3.10/site-packages (from scikit-learn>=0.21.3->seqeval) (1.11.4)
40
+ Requirement already satisfied: joblib>=1.1.1 in /opt/conda/lib/python3.10/site-packages (from scikit-learn>=0.21.3->seqeval) (1.3.2)
41
+ Requirement already satisfied: threadpoolctl>=2.0.0 in /opt/conda/lib/python3.10/site-packages (from scikit-learn>=0.21.3->seqeval) (3.2.0)
42
+ Looking in indexes: https://download.pytorch.org/whl/nightly/cu117
43
+ Collecting numpy
44
+ Using cached https://download.pytorch.org/whl/nightly/numpy-1.24.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB)
45
+ Collecting torch
46
+ Using cached https://download.pytorch.org/whl/nightly/cu117/torch-2.1.0.dev20230621%2Bcu117-cp310-cp310-linux_x86_64.whl (1886.6 MB)
47
+ ERROR: Could not find a version that satisfies the requirement torchvision (from versions: none)
48
+ ERROR: No matching distribution found for torchvision
49
+ /kaggle/input/pii-detection-removal-from-educational-data/sample_submission.csv
50
+ /kaggle/input/pii-detection-removal-from-educational-data/train.json
51
+ /kaggle/input/pii-detection-removal-from-educational-data/test.json
52
+ Token will not been saved to git credential helper. Pass `add_to_git_credential=True` if you want to set the git credential as well.
53
+ Token is valid (permission: write).
54
+ Your token has been saved to /root/.cache/huggingface/token
55
+ Login successful
56
+ wandb: WARNING Calling wandb.login() after wandb.init() has no effect.
57
+ Some weights of DistilBertForTokenClassification were not initialized from the model checkpoint at malduwais/distilbert-base-uncased-finetuned-ner and are newly initialized because the shapes did not match:
58
+ - classifier.bias: found shape torch.Size([9]) in the checkpoint and torch.Size([13]) in the model instantiated
59
+ - classifier.weight: found shape torch.Size([9, 768]) in the checkpoint and torch.Size([13, 768]) in the model instantiated
60
+ You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
61
+ /opt/conda/lib/python3.10/site-packages/seqeval/metrics/v1.py:57: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.
62
+ _warn_prf(average, modifier, msg_start, len(result))
63
+ /opt/conda/lib/python3.10/site-packages/seqeval/metrics/v1.py:57: UndefinedMetricWarning: Recall and F-score are ill-defined and being set to 0.0 in labels with no true samples. Use `zero_division` parameter to control this behavior.
64
+ _warn_prf(average, modifier, msg_start, len(result))
wandb/run-20240227_190534-i3bofc05/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"eval/loss": 0.33449798822402954, "eval/precision": 0.02178217821782178, "eval/recall": 0.55, "eval/f1": 0.0419047619047619, "eval/accuracy": 0.9905449048527667, "eval/f5": 0.06567164179104479, "eval/runtime": 32.0228, "eval/samples_per_second": 42.532, "eval/steps_per_second": 2.686, "train/epoch": 1.0, "train/global_step": 86, "_timestamp": 1709060936.9700055, "_runtime": 202.16963362693787, "_step": 1, "train/train_runtime": 202.2036, "train/train_samples_per_second": 26.928, "train/train_steps_per_second": 0.425, "train/total_flos": 711547623705600.0, "train/train_loss": 1.2156791687011719}
 
1
+ {"eval/loss": 0.32042214274406433, "eval/precision": 0.01694252573960641, "eval/recall": 0.52, "eval/f1": 0.03281585258109302, "eval/accuracy": 0.9866904165864304, "eval/f5": 0.05602240896358543, "eval/runtime": 32.2479, "eval/samples_per_second": 42.235, "eval/steps_per_second": 2.667, "train/epoch": 1.0, "train/global_step": 86, "_timestamp": 1709063050.7890673, "_runtime": 2315.988695383072, "_step": 3, "train/train_runtime": 176.0058, "train/train_samples_per_second": 30.936, "train/train_steps_per_second": 0.489, "train/total_flos": 711547623705600.0, "train/train_loss": 1.1446661838265353}
wandb/run-20240227_190534-i3bofc05/logs/debug-internal.log CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20240227_190534-i3bofc05/logs/debug.log CHANGED
@@ -29,3 +29,88 @@ config: {}
29
  2024-02-27 19:06:05,430 INFO MainThread:345 [wandb_run.py:_redirect():2178] Redirects installed.
30
  2024-02-27 19:06:05,431 INFO MainThread:345 [wandb_init.py:init():847] run started, returning control to user process
31
  2024-02-27 19:06:05,437 INFO MainThread:345 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 30522, 'max_position_embeddings': 512, 'sinusoidal_pos_embds': False, 'n_layers': 6, 'n_heads': 12, 'dim': 768, 'hidden_dim': 3072, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation': 'gelu', 'initializer_range': 0.02, 'qa_dropout': 0.1, 'seq_classif_dropout': 0.2, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['DistilBertForTokenClassification'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2', 3: 'LABEL_3', 4: 'LABEL_4', 5: 'LABEL_5', 6: 'LABEL_6', 7: 'LABEL_7', 8: 'LABEL_8', 9: 'LABEL_9', 10: 'LABEL_10', 11: 'LABEL_11', 12: 'LABEL_12'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2, 'LABEL_3': 3, 'LABEL_4': 4, 'LABEL_5': 5, 'LABEL_6': 6, 'LABEL_7': 7, 'LABEL_8': 8, 'LABEL_9': 9, 'LABEL_10': 10, 'LABEL_11': 11, 'LABEL_12': 12}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'malduwais/distilbert-base-uncased-finetuned-ner', 'transformers_version': '4.37.0', 'model_type': 'distilbert', 'tie_weights_': True, 'output_dir': '/kaggle/working', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb27_19-05-30_fcc1160403f2', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'loss', 'greater_is_better': False, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  2024-02-27 19:06:05,430 INFO MainThread:345 [wandb_run.py:_redirect():2178] Redirects installed.
30
  2024-02-27 19:06:05,431 INFO MainThread:345 [wandb_init.py:init():847] run started, returning control to user process
31
  2024-02-27 19:06:05,437 INFO MainThread:345 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 30522, 'max_position_embeddings': 512, 'sinusoidal_pos_embds': False, 'n_layers': 6, 'n_heads': 12, 'dim': 768, 'hidden_dim': 3072, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation': 'gelu', 'initializer_range': 0.02, 'qa_dropout': 0.1, 'seq_classif_dropout': 0.2, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['DistilBertForTokenClassification'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2', 3: 'LABEL_3', 4: 'LABEL_4', 5: 'LABEL_5', 6: 'LABEL_6', 7: 'LABEL_7', 8: 'LABEL_8', 9: 'LABEL_9', 10: 'LABEL_10', 11: 'LABEL_11', 12: 'LABEL_12'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2, 'LABEL_3': 3, 'LABEL_4': 4, 'LABEL_5': 5, 'LABEL_6': 6, 'LABEL_7': 7, 'LABEL_8': 8, 'LABEL_9': 9, 'LABEL_10': 10, 'LABEL_11': 11, 'LABEL_12': 12}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'malduwais/distilbert-base-uncased-finetuned-ner', 'transformers_version': '4.37.0', 'model_type': 'distilbert', 'tie_weights_': True, 'output_dir': '/kaggle/working', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb27_19-05-30_fcc1160403f2', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'loss', 'greater_is_better': False, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
32
+ 2024-02-27 19:09:05,083 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
33
+ 2024-02-27 19:09:05,083 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
34
+ 2024-02-27 19:09:05,089 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
35
+ 2024-02-27 19:09:05,285 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
36
+ 2024-02-27 19:09:05,285 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
37
+ 2024-02-27 19:09:05,290 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
38
+ 2024-02-27 19:09:05,294 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
39
+ 2024-02-27 19:09:05,295 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
40
+ 2024-02-27 19:09:05,301 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
41
+ 2024-02-27 19:09:05,468 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
42
+ 2024-02-27 19:09:05,468 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
43
+ 2024-02-27 19:09:05,474 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
44
+ 2024-02-27 19:09:06,899 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
45
+ 2024-02-27 19:09:06,899 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
46
+ 2024-02-27 19:22:51,710 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
47
+ 2024-02-27 19:22:51,754 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
48
+ 2024-02-27 19:22:51,754 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
49
+ 2024-02-27 19:22:59,838 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
50
+ 2024-02-27 19:22:59,851 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
51
+ 2024-02-27 19:22:59,852 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
52
+ 2024-02-27 19:23:12,301 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
53
+ 2024-02-27 19:23:12,414 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
54
+ 2024-02-27 19:23:12,414 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
55
+ 2024-02-27 19:23:31,995 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
56
+ 2024-02-27 19:23:43,602 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
57
+ 2024-02-27 19:23:43,603 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
58
+ 2024-02-27 19:39:48,403 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
59
+ 2024-02-27 19:40:25,322 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
60
+ 2024-02-27 19:40:25,322 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
61
+ 2024-02-27 19:40:25,330 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
62
+ 2024-02-27 19:40:25,331 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
63
+ 2024-02-27 19:40:25,332 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
64
+ 2024-02-27 19:40:25,340 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
65
+ 2024-02-27 19:40:27,057 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
66
+ 2024-02-27 19:40:27,057 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
67
+ 2024-02-27 19:40:27,064 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
68
+ 2024-02-27 19:40:27,195 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
69
+ 2024-02-27 19:40:27,195 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
70
+ 2024-02-27 19:40:27,202 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
71
+ 2024-02-27 19:40:27,817 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
72
+ 2024-02-27 19:40:27,817 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
73
+ 2024-02-27 19:40:27,824 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
74
+ 2024-02-27 19:40:33,665 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
75
+ 2024-02-27 19:40:33,666 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
76
+ 2024-02-27 19:40:33,676 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
77
+ 2024-02-27 19:40:33,678 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
78
+ 2024-02-27 19:40:33,678 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
79
+ 2024-02-27 19:40:33,685 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
80
+ 2024-02-27 19:40:40,172 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
81
+ 2024-02-27 19:40:40,172 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
82
+ 2024-02-27 19:40:40,179 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
83
+ 2024-02-27 19:41:07,056 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
84
+ 2024-02-27 19:41:07,056 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
85
+ 2024-02-27 19:41:07,065 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
86
+ 2024-02-27 19:41:07,102 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
87
+ 2024-02-27 19:41:07,102 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
88
+ 2024-02-27 19:41:07,108 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
89
+ 2024-02-27 19:41:07,119 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
90
+ 2024-02-27 19:41:07,119 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
91
+ 2024-02-27 19:41:07,127 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
92
+ 2024-02-27 19:41:07,957 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
93
+ 2024-02-27 19:41:07,958 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
94
+ 2024-02-27 19:41:07,963 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
95
+ 2024-02-27 19:41:08,494 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
96
+ 2024-02-27 19:41:08,494 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
97
+ 2024-02-27 19:41:08,504 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
98
+ 2024-02-27 19:41:08,507 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
99
+ 2024-02-27 19:41:08,507 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
100
+ 2024-02-27 19:41:08,515 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
101
+ 2024-02-27 19:41:08,726 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
102
+ 2024-02-27 19:41:08,726 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
103
+ 2024-02-27 19:41:08,732 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
104
+ 2024-02-27 19:41:08,733 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
105
+ 2024-02-27 19:41:08,733 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
106
+ 2024-02-27 19:41:08,739 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
107
+ 2024-02-27 19:41:09,530 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
108
+ 2024-02-27 19:41:09,530 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
109
+ 2024-02-27 19:41:09,539 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
110
+ 2024-02-27 19:41:09,541 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
111
+ 2024-02-27 19:41:09,541 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
112
+ 2024-02-27 19:41:09,548 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
113
+ 2024-02-27 19:41:09,556 INFO MainThread:345 [jupyter.py:save_ipynb():373] not saving jupyter notebook
114
+ 2024-02-27 19:41:09,557 INFO MainThread:345 [wandb_init.py:_pause_backend():437] pausing backend
115
+ 2024-02-27 19:41:09,564 INFO MainThread:345 [wandb_init.py:_resume_backend():442] resuming backend
116
+ 2024-02-27 19:41:14,793 INFO MainThread:345 [wandb_run.py:_config_callback():1342] config_cb None None {'vocab_size': 30522, 'max_position_embeddings': 512, 'sinusoidal_pos_embds': False, 'n_layers': 6, 'n_heads': 12, 'dim': 768, 'hidden_dim': 3072, 'dropout': 0.1, 'attention_dropout': 0.1, 'activation': 'gelu', 'initializer_range': 0.02, 'qa_dropout': 0.1, 'seq_classif_dropout': 0.2, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'float32', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['DistilBertForTokenClassification'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1', 2: 'LABEL_2', 3: 'LABEL_3', 4: 'LABEL_4', 5: 'LABEL_5', 6: 'LABEL_6', 7: 'LABEL_7', 8: 'LABEL_8', 9: 'LABEL_9', 10: 'LABEL_10', 11: 'LABEL_11', 12: 'LABEL_12'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1, 'LABEL_2': 2, 'LABEL_3': 3, 'LABEL_4': 4, 'LABEL_5': 5, 'LABEL_6': 6, 'LABEL_7': 7, 'LABEL_8': 8, 'LABEL_9': 9, 'LABEL_10': 10, 'LABEL_11': 11, 'LABEL_12': 12}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': None, 'pad_token_id': 0, 'eos_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'malduwais/distilbert-base-uncased-finetuned-ner', 'transformers_version': '4.37.0', 'model_type': 'distilbert', 'tie_weights_': True, 'output_dir': '/kaggle/working', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'evaluation_strategy': 'epoch', 'prediction_loss_only': False, 'per_device_train_batch_size': 32, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 2e-05, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 1, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/kaggle/working/runs/Feb27_19-41-09_fcc1160403f2', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 500, 'logging_nan_inf_filter': True, 'save_strategy': 'epoch', 'save_steps': 500, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'past_index': -1, 'run_name': '/kaggle/working', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': True, 'metric_for_best_model': 'loss', 'greater_is_better': False, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'adamw_torch', 'optim_args': None, 'adafactor': False, 'group_by_length': False, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': False, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
wandb/run-20240227_190534-i3bofc05/run-i3bofc05.wandb CHANGED
Binary files a/wandb/run-20240227_190534-i3bofc05/run-i3bofc05.wandb and b/wandb/run-20240227_190534-i3bofc05/run-i3bofc05.wandb differ