JudeChaer commited on
Commit
397d828
·
verified ·
1 Parent(s): 7cef7bd

End of training

Browse files
README.md ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: roberta-base
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: fires
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # fires
15
+
16
+ This model is a fine-tuned version of [roberta-base](https://huggingface.co/roberta-base) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.4685
19
+
20
+ ## Model description
21
+
22
+ More information needed
23
+
24
+ ## Intended uses & limitations
25
+
26
+ More information needed
27
+
28
+ ## Training and evaluation data
29
+
30
+ More information needed
31
+
32
+ ## Training procedure
33
+
34
+ ### Training hyperparameters
35
+
36
+ The following hyperparameters were used during training:
37
+ - learning_rate: 5e-05
38
+ - train_batch_size: 8
39
+ - eval_batch_size: 8
40
+ - seed: 42
41
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
+ - lr_scheduler_type: linear
43
+ - lr_scheduler_warmup_steps: 500
44
+ - num_epochs: 4
45
+
46
+ ### Training results
47
+
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:-----:|:----:|:---------------:|
50
+ | 0.8502 | 1.0 | 120 | 0.6152 |
51
+ | 0.3435 | 2.0 | 240 | 0.4685 |
52
+ | 0.4425 | 3.0 | 360 | 0.5780 |
53
+ | 0.291 | 4.0 | 480 | 0.7982 |
54
+
55
+
56
+ ### Framework versions
57
+
58
+ - Transformers 4.38.2
59
+ - Pytorch 2.2.1+cu121
60
+ - Datasets 2.18.0
61
+ - Tokenizers 0.15.2
logs/events.out.tfevents.1709806805.mintj.12719.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:22499eb00d5cb7fd283ed5abfc7486804ec86e007248099c88bb4b89936c2637
3
- size 7365
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69219df97650dce7facb04d159aa7570b531ebb636fb0c0d88d9a3465ea7c7aa
3
+ size 16128
logs/events.out.tfevents.1709807046.mintj.12719.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee52a9d5dd7e0ca57d54d3e646992c681b124f92ded44f1d26a8e605f314cd5c
3
+ size 311
logs/events.out.tfevents.1709807504.mintj.13520.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9956ee12fe6145e5f521b342707dd0a431f035ed4778559bda1c97bcecd35683
3
+ size 16128
logs/events.out.tfevents.1709807971.mintj.13520.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc0c69a9c91ca5616dde7c94f9081a268569466c668709dfdf822ffb359c6a65
3
+ size 311
logs/events.out.tfevents.1709808208.mintj.14256.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:377a97a9677398147a6e1b37fca26324a2868ab468117a38c58e195ea80ad26d
3
+ size 16128
logs/events.out.tfevents.1709808478.mintj.14256.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8762a4632549902927abf75f6447458ccbba16a561d69c1ba16e1e282effc368
3
+ size 311
logs/events.out.tfevents.1709808586.mintj.14936.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9edcd4a945e2440b05c2efbb6e5fa4b9a530ecf30f45d1f40f7d612031f8d1d6
3
+ size 10522
logs/events.out.tfevents.1709808953.mintj.14936.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2461d0bb42fdfd48faed5f4f626b756552c684cf9710e3cb87ee5267728ac9ae
3
+ size 311
logs/events.out.tfevents.1709809811.mintj.3888.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbd47e00ffaa5d32b78cf2cc7cdcf6bbe724f277e9adfb189d8c0e14ca6fa6cf
3
+ size 16386
logs/events.out.tfevents.1709810092.mintj.3888.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f74be40315770994c03ea540942a5318751e09a32104414020f95153a171186e
3
+ size 311
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:77bd9655292baf36234c32fdc827cccf2790eb82b75abfc34c4affb9b2f1c9b3
3
  size 498615900
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de80f3972d334f195af3e7591184b12a912ffba130ff8ae4996fac58def41d26
3
  size 498615900
special_tokens_map.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": "<s>",
3
+ "cls_token": "<s>",
4
+ "eos_token": "</s>",
5
+ "mask_token": {
6
+ "content": "<mask>",
7
+ "lstrip": true,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false
11
+ },
12
+ "pad_token": "<pad>",
13
+ "sep_token": "</s>",
14
+ "unk_token": "<unk>"
15
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,57 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<s>",
6
+ "lstrip": false,
7
+ "normalized": true,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "<pad>",
14
+ "lstrip": false,
15
+ "normalized": true,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "</s>",
22
+ "lstrip": false,
23
+ "normalized": true,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "3": {
29
+ "content": "<unk>",
30
+ "lstrip": false,
31
+ "normalized": true,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "50264": {
37
+ "content": "<mask>",
38
+ "lstrip": true,
39
+ "normalized": false,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ }
44
+ },
45
+ "bos_token": "<s>",
46
+ "clean_up_tokenization_spaces": true,
47
+ "cls_token": "<s>",
48
+ "eos_token": "</s>",
49
+ "errors": "replace",
50
+ "mask_token": "<mask>",
51
+ "model_max_length": 512,
52
+ "pad_token": "<pad>",
53
+ "sep_token": "</s>",
54
+ "tokenizer_class": "RobertaTokenizer",
55
+ "trim_offsets": true,
56
+ "unk_token": "<unk>"
57
+ }
vocab.json ADDED
The diff for this file is too large to render. See raw diff