Hugging Face's logo

MikeGreen2710
/
training_with_callbacks

Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files
xet
 Metrics Community
MikeGreen2710 commited on
Commit
87d60fa
·
verified ·
1 Parent(s): 6851e3e

MikeGreen2710/model_location_with_extra_16_features

Browse files
Files changed (18) hide show
  1. README.md +79 -0
  2. config.json +30 -0
  3. model.safetensors +3 -0
  4. runs/Apr01_04-00-49_ece4728d2eeb/events.out.tfevents.1711944054.ece4728d2eeb.4936.0 +3 -0
  5. runs/Apr01_04-26-36_ece4728d2eeb/events.out.tfevents.1711945608.ece4728d2eeb.4936.1 +3 -0
  6. runs/Apr01_05-21-01_ece4728d2eeb/events.out.tfevents.1711948869.ece4728d2eeb.4936.2 +3 -0
  7. runs/Apr01_09-07-03_ece4728d2eeb/events.out.tfevents.1711962431.ece4728d2eeb.4936.3 +3 -0
  8. runs/Apr01_09-07-41_ece4728d2eeb/events.out.tfevents.1711962467.ece4728d2eeb.4936.4 +3 -0
  9. runs/Apr01_09-35-40_ece4728d2eeb/events.out.tfevents.1711964143.ece4728d2eeb.4936.5 +3 -0
  10. runs/Apr02_00-58-37_49fd5aaf7c90/events.out.tfevents.1712019521.49fd5aaf7c90.6589.0 +3 -0
  11. runs/Apr02_01-00-50_49fd5aaf7c90/events.out.tfevents.1712019654.49fd5aaf7c90.9353.0 +3 -0
  12. runs/Apr02_01-23-07_49fd5aaf7c90/events.out.tfevents.1712020997.49fd5aaf7c90.9353.1 +3 -0
  13. runs/Apr02_02-27-40_49fd5aaf7c90/events.out.tfevents.1712024868.49fd5aaf7c90.9353.2 +3 -0
  14. runs/Apr02_02-31-54_49fd5aaf7c90/events.out.tfevents.1712025118.49fd5aaf7c90.9353.3 +3 -0
  15. runs/Apr18_09-33-52_972f59438847/events.out.tfevents.1713432837.972f59438847.5126.0 +3 -0
  16. runs/Apr18_10-01-28_972f59438847/events.out.tfevents.1713434491.972f59438847.5126.1 +3 -0
  17. runs/Apr18_11-31-48_972f59438847/events.out.tfevents.1713439913.972f59438847.5126.2 +3 -0
  18. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,79 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: MikeGreen2710/mlm_listing_1.79
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - f1
7
+ model-index:
8
+ - name: training_with_callbacks
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/ommlops/huggingface/runs/cib2hyrr)
16
+ # training_with_callbacks
17
+
18
+ This model is a fine-tuned version of [MikeGreen2710/mlm_listing_1.79](https://huggingface.co/MikeGreen2710/mlm_listing_1.79) on an unknown dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.6543
21
+ - F1: 0.9208
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
+
35
+ ## Training procedure
36
+
37
+ ### Training hyperparameters
38
+
39
+ The following hyperparameters were used during training:
40
+ - learning_rate: 2e-05
41
+ - train_batch_size: 24
42
+ - eval_batch_size: 12
43
+ - seed: 42
44
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: linear
46
+ - num_epochs: 20
47
+
48
+ ### Training results
49
+
50
+ | Training Loss | Epoch | Step | Validation Loss | F1 |
51
+ |:-------------:|:-----:|:----:|:---------------:|:------:|
52
+ | 0.0824 | 1.0 | 450 | 0.3580 | 0.9060 |
53
+ | 0.0511 | 2.0 | 900 | 0.4426 | 0.9124 |
54
+ | 0.026 | 3.0 | 1350 | 0.5414 | 0.9068 |
55
+ | 0.0217 | 4.0 | 1800 | 0.5045 | 0.9143 |
56
+ | 0.0173 | 5.0 | 2250 | 0.5599 | 0.9118 |
57
+ | 0.0118 | 6.0 | 2700 | 0.6114 | 0.9149 |
58
+ | 0.0064 | 7.0 | 3150 | 0.6536 | 0.9134 |
59
+ | 0.0113 | 8.0 | 3600 | 0.7119 | 0.9011 |
60
+ | 0.0075 | 9.0 | 4050 | 0.6683 | 0.9124 |
61
+ | 0.0069 | 10.0 | 4500 | 0.6543 | 0.9208 |
62
+ | 0.0042 | 11.0 | 4950 | 0.6937 | 0.9158 |
63
+ | 0.0062 | 12.0 | 5400 | 0.7119 | 0.9184 |
64
+ | 0.0048 | 13.0 | 5850 | 0.7300 | 0.9143 |
65
+ | 0.0021 | 14.0 | 6300 | 0.7877 | 0.9110 |
66
+ | 0.0032 | 15.0 | 6750 | 0.7892 | 0.9116 |
67
+ | 0.003 | 16.0 | 7200 | 0.7744 | 0.9091 |
68
+ | 0.0069 | 17.0 | 7650 | 0.7118 | 0.9184 |
69
+ | 0.0006 | 18.0 | 8100 | 0.7633 | 0.9143 |
70
+ | 0.0011 | 19.0 | 8550 | 0.7438 | 0.9200 |
71
+ | 0.0001 | 20.0 | 9000 | 0.7461 | 0.9200 |
72
+
73
+
74
+ ### Framework versions
75
+
76
+ - Transformers 4.42.4
77
+ - Pytorch 2.3.0+cu121
78
+ - Datasets 2.20.0
79
+ - Tokenizers 0.19.1
config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "MikeGreen2710/mlm_listing_1.79",
3
+ "architectures": [
4
+ "CustomSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "bos_token_id": 0,
8
+ "classifier_dropout": null,
9
+ "eos_token_id": 2,
10
+ "gradient_checkpointing": false,
11
+ "hidden_act": "gelu",
12
+ "hidden_dropout_prob": 0.1,
13
+ "hidden_size": 768,
14
+ "initializer_range": 0.02,
15
+ "intermediate_size": 3072,
16
+ "layer_norm_eps": 1e-05,
17
+ "max_position_embeddings": 258,
18
+ "model_type": "roberta",
19
+ "num_attention_heads": 12,
20
+ "num_hidden_layers": 12,
21
+ "pad_token_id": 1,
22
+ "position_embedding_type": "absolute",
23
+ "problem_type": "single_label_classification",
24
+ "tokenizer_class": "PhobertTokenizer",
25
+ "torch_dtype": "float32",
26
+ "transformers_version": "4.42.4",
27
+ "type_vocab_size": 1,
28
+ "use_cache": true,
29
+ "vocab_size": 64001
30
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:471c6e4812f2ed0fd8873de54b188115c795e0b4a2c57aa6ad890cfbe4457be0
3
+ size 542485464
runs/Apr01_04-00-49_ece4728d2eeb/events.out.tfevents.1711944054.ece4728d2eeb.4936.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02841d9d2ce6d0079974c46ca9fe34de34ede7e950767f492353707ffda00db8
3
+ size 6622
runs/Apr01_04-26-36_ece4728d2eeb/events.out.tfevents.1711945608.ece4728d2eeb.4936.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5360c3963aef47605a3f34474b3111314d38afd74e5f015b0e7a8ad62430d6bf
3
+ size 6403
runs/Apr01_05-21-01_ece4728d2eeb/events.out.tfevents.1711948869.ece4728d2eeb.4936.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:320f2534dd3b35bb91e58bb5e9872a8ba578d1164524d9ee5515762cab2cdaf9
3
+ size 8496
runs/Apr01_09-07-03_ece4728d2eeb/events.out.tfevents.1711962431.ece4728d2eeb.4936.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe85dfe5870d8548eb77ab003af112cac7914e54ffedb0216d1e4a5396d4e0b7
3
+ size 5283
runs/Apr01_09-07-41_ece4728d2eeb/events.out.tfevents.1711962467.ece4728d2eeb.4936.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88be364fb7f5052ffa061983e585d2844a82b42b4f9bc59beecd2802f9e4c646
3
+ size 21936
runs/Apr01_09-35-40_ece4728d2eeb/events.out.tfevents.1711964143.ece4728d2eeb.4936.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63444d1517e3be1b7d097c3508be1a9de08485a65015a9023562e2ec6b25eca3
3
+ size 23967
runs/Apr02_00-58-37_49fd5aaf7c90/events.out.tfevents.1712019521.49fd5aaf7c90.6589.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebe3a294d71a20fb67b35fa0fbaf06915a6a6820f3e0a1cc9f99b8c3e285cea3
3
+ size 4184
runs/Apr02_01-00-50_49fd5aaf7c90/events.out.tfevents.1712019654.49fd5aaf7c90.9353.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ffb69888828aa9fc51cedce3bc44e413dbc52242e51eb20c5550328beeaad5e
3
+ size 6622
runs/Apr02_01-23-07_49fd5aaf7c90/events.out.tfevents.1712020997.49fd5aaf7c90.9353.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f4cb0a3f3f0762d17e53fc6b9c45dcf9feec4e9adb48448f27cdf99a6534a05
3
+ size 6403
runs/Apr02_02-27-40_49fd5aaf7c90/events.out.tfevents.1712024868.49fd5aaf7c90.9353.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ef096ab8534f036cd62431d3f9d05f14ddba7cb53a4d48998ea88024d2112a4
3
+ size 6633
runs/Apr02_02-31-54_49fd5aaf7c90/events.out.tfevents.1712025118.49fd5aaf7c90.9353.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c3047f888aa21cb5d957966e8af52961139c7585b714cb34626136da74c580a
3
+ size 36249
runs/Apr18_09-33-52_972f59438847/events.out.tfevents.1713432837.972f59438847.5126.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:deb67c22490bd28bae25fcfde3e9d5b7b51b7a2f5d16cf6b778daf758270a29e
3
+ size 6903
runs/Apr18_10-01-28_972f59438847/events.out.tfevents.1713434491.972f59438847.5126.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51b4600e39f07a8b083c228f22aef2dd3391ffbed1284eb68c59065f778442f1
3
+ size 9164
runs/Apr18_11-31-48_972f59438847/events.out.tfevents.1713439913.972f59438847.5126.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5536211ae53816c5bcab825aa7d154bc03a3872d9c79ce6000d2663e3e991ef1
3
+ size 5435
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d136a12c3ce8893e3a0d12b8501b172c9c90f00eafba944cc44c63ea64e88dcc
3
+ size 5112