angela220 commited on
Commit
23a0666
·
verified ·
1 Parent(s): 81de4b3

Upload 8 files

Browse files
Files changed (5) hide show
  1. README.md +31 -18
  2. config.json +1 -1
  3. gitattributes +35 -0
  4. model.safetensors +1 -1
  5. training_args.bin +1 -1
README.md CHANGED
@@ -15,19 +15,32 @@ model-index:
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
- # fine-tuned Deberta mdoel for climate claims verification task(using gold evidence)
19
 
20
- This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on climate claim verification training dataset(using gold evidence provided by the training set).
21
- It achieves the following results on the development set:
22
- - Loss: 0.8805
23
- - F1: 0.7383
24
- - Accuracy: 0.8117
25
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26
 
27
  ### Training hyperparameters
28
 
29
  The following hyperparameters were used during training:
30
- - learning_rate: 2e-05
31
  - train_batch_size: 4
32
  - eval_batch_size: 4
33
  - seed: 42
@@ -42,21 +55,21 @@ The following hyperparameters were used during training:
42
 
43
  | Training Loss | Epoch | Step | Validation Loss | F1 | Accuracy |
44
  |:-------------:|:-----:|:----:|:---------------:|:------:|:--------:|
45
- | 5.1051 | 1.0 | 77 | 1.2925 | 0.1910 | 0.3506 |
46
- | 4.7117 | 2.0 | 154 | 1.0855 | 0.3861 | 0.6429 |
47
- | 4.3050 | 3.0 | 231 | 1.0556 | 0.3987 | 0.6623 |
48
- | 3.5951 | 4.0 | 308 | 0.9764 | 0.6400 | 0.7662 |
49
- | 3.1353 | 5.0 | 385 | 0.8932 | 0.6145 | 0.7468 |
50
- | 2.6044 | 6.0 | 462 | 0.9282 | 0.6647 | 0.7662 |
51
- | 2.5715 | 7.0 | 539 | 0.8573 | 0.7067 | 0.7792 |
52
- | 2.1888 | 8.0 | 616 | 0.8713 | 0.6826 | 0.7792 |
53
- | 1.9936 | 9.0 | 693 | 0.8703 | 0.7249 | 0.8117 |
54
- | 1.8500 | 10.0 | 770 | 0.8805 | 0.7383 | 0.8117 |
55
 
56
 
57
  ### Framework versions
58
 
59
- - Transformers 5.9.0
60
  - Pytorch 2.10.0+cu128
61
  - Datasets 4.8.5
62
  - Tokenizers 0.22.2
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
+ # out
19
 
20
+ This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on the None dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 0.9680
23
+ - F1: 0.7035
24
+ - Accuracy: 0.7857
25
 
26
+ ## Model description
27
+
28
+ More information needed
29
+
30
+ ## Intended uses & limitations
31
+
32
+ More information needed
33
+
34
+ ## Training and evaluation data
35
+
36
+ More information needed
37
+
38
+ ## Training procedure
39
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 1.5e-05
44
  - train_batch_size: 4
45
  - eval_batch_size: 4
46
  - seed: 42
 
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:--------:|
58
+ | 5.4135 | 1.0 | 77 | 1.3468 | 0.1532 | 0.4416 |
59
+ | 4.6607 | 2.0 | 154 | 1.1471 | 0.3819 | 0.6364 |
60
+ | 4.2591 | 3.0 | 231 | 1.1545 | 0.3801 | 0.6234 |
61
+ | 3.9299 | 4.0 | 308 | 0.9857 | 0.6322 | 0.7013 |
62
+ | 3.2692 | 5.0 | 385 | 0.8877 | 0.6500 | 0.7273 |
63
+ | 2.7183 | 6.0 | 462 | 1.0321 | 0.6360 | 0.7403 |
64
+ | 2.3779 | 7.0 | 539 | 0.9220 | 0.7017 | 0.7727 |
65
+ | 2.1893 | 8.0 | 616 | 0.9742 | 0.7196 | 0.7922 |
66
+ | 1.9169 | 9.0 | 693 | 0.9781 | 0.7034 | 0.7857 |
67
+ | 1.8150 | 10.0 | 770 | 0.9680 | 0.7035 | 0.7857 |
68
 
69
 
70
  ### Framework versions
71
 
72
+ - Transformers 5.8.0
73
  - Pytorch 2.10.0+cu128
74
  - Datasets 4.8.5
75
  - Tokenizers 0.22.2
config.json CHANGED
@@ -44,7 +44,7 @@
44
  "relative_attention": true,
45
  "share_att_key": true,
46
  "tie_word_embeddings": true,
47
- "transformers_version": "5.9.0",
48
  "type_vocab_size": 0,
49
  "use_cache": false,
50
  "vocab_size": 128100
 
44
  "relative_attention": true,
45
  "share_att_key": true,
46
  "tie_word_embeddings": true,
47
+ "transformers_version": "5.8.0",
48
  "type_vocab_size": 0,
49
  "use_cache": false,
50
  "vocab_size": 128100
gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:29db2cccb0d0c936ceea2f3fb6bd53656df0f8397ef3b592e3a1e70486feb37c
3
  size 737725432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61929139a8a9f16230bee25ce1e445dce6a7c762b955d740abd7eaa1cfad2eac
3
  size 737725432
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:723dfa3dec394a9db2312e9b38cbcff364d7348350e85f55a3db4b5daa1578b7
3
  size 5329
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cc8e7a9fe881d864469c3298c9364b50c98364976b2d109898b34e9fb77d481
3
  size 5329