Hugging Face's logo

Stern5497
/
org_modelorg_model

PEFT
Safetensors
Generated from Trainer
Model card Files
xet
Community
Stern5497 commited on
Commit
78faf6f
·
verified ·
1 Parent(s): cb3126d

mistral-lp2-org_aug_b

Browse files
Files changed (3) hide show
  1. README.md +20 -20
  2. adapter_config.json +3 -3
  3. adapter_model.safetensors +2 -2
README.md CHANGED
@@ -16,10 +16,10 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.8643
20
- - F1 Micro: 0.6606
21
- - F1 Macro: 0.6479
22
- - F1 Weighted: 0.6611
23
 
24
  ## Model description
25
 
@@ -50,22 +50,22 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | F1 Micro | F1 Macro | F1 Weighted |
52
  |:-------------:|:------:|:----:|:---------------:|:--------:|:--------:|:-----------:|
53
- | 1.6117 | 0.0154 | 25 | 1.3679 | 0.5541 | 0.4980 | 0.5313 |
54
- | 1.2903 | 0.0308 | 50 | 1.2094 | 0.6156 | 0.5779 | 0.6029 |
55
- | 1.164 | 0.0462 | 75 | 1.0987 | 0.6206 | 0.5931 | 0.6141 |
56
- | 1.1168 | 0.0615 | 100 | 1.1057 | 0.6376 | 0.5883 | 0.6165 |
57
- | 1.026 | 0.0769 | 125 | 0.9896 | 0.6314 | 0.6196 | 0.6328 |
58
- | 0.9481 | 0.0923 | 150 | 0.9619 | 0.6438 | 0.6173 | 0.6373 |
59
- | 0.9797 | 0.1077 | 175 | 0.9549 | 0.6514 | 0.6191 | 0.6411 |
60
- | 1.045 | 0.1231 | 200 | 0.9121 | 0.6541 | 0.6403 | 0.6543 |
61
- | 0.8954 | 0.1385 | 225 | 0.8991 | 0.6595 | 0.6418 | 0.6576 |
62
- | 0.9245 | 0.1538 | 250 | 0.8887 | 0.6588 | 0.6433 | 0.6580 |
63
- | 0.8636 | 0.1692 | 275 | 0.8824 | 0.6602 | 0.6458 | 0.6600 |
64
- | 0.846 | 0.1846 | 300 | 0.8793 | 0.6672 | 0.6451 | 0.6627 |
65
- | 0.8885 | 0.2 | 325 | 0.8820 | 0.6696 | 0.6431 | 0.6624 |
66
- | 0.8323 | 0.2154 | 350 | 0.8652 | 0.6618 | 0.6474 | 0.6616 |
67
- | 0.9313 | 0.2308 | 375 | 0.8654 | 0.6601 | 0.6477 | 0.6608 |
68
- | 0.857 | 0.2462 | 400 | 0.8643 | 0.6606 | 0.6479 | 0.6611 |
69
 
70
 
71
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 1.0305
20
+ - F1 Micro: 0.7988
21
+ - F1 Macro: 0.7745
22
+ - F1 Weighted: 0.8091
23
 
24
  ## Model description
25
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | F1 Micro | F1 Macro | F1 Weighted |
52
  |:-------------:|:------:|:----:|:---------------:|:--------:|:--------:|:-----------:|
53
+ | 1.7847 | 0.0064 | 25 | 1.4983 | 0.7827 | 0.7547 | 0.7929 |
54
+ | 1.3333 | 0.0127 | 50 | 1.2986 | 0.7926 | 0.7660 | 0.8031 |
55
+ | 1.2721 | 0.0191 | 75 | 1.2255 | 0.7755 | 0.7520 | 0.7862 |
56
+ | 1.127 | 0.0255 | 100 | 1.1722 | 0.7945 | 0.7694 | 0.8053 |
57
+ | 1.1108 | 0.0318 | 125 | 1.1561 | 0.7922 | 0.7556 | 0.7971 |
58
+ | 1.0969 | 0.0382 | 150 | 1.1181 | 0.7875 | 0.7581 | 0.7955 |
59
+ | 1.0714 | 0.0446 | 175 | 1.1001 | 0.7884 | 0.7658 | 0.7993 |
60
+ | 1.0219 | 0.0510 | 200 | 1.0758 | 0.8000 | 0.7727 | 0.8091 |
61
+ | 1.0979 | 0.0573 | 225 | 1.0671 | 0.7973 | 0.7656 | 0.8040 |
62
+ | 1.0846 | 0.0637 | 250 | 1.0632 | 0.7866 | 0.7582 | 0.7944 |
63
+ | 0.9977 | 0.0701 | 275 | 1.0590 | 0.7934 | 0.7600 | 0.7991 |
64
+ | 1.1262 | 0.0764 | 300 | 1.0404 | 0.7984 | 0.7699 | 0.8066 |
65
+ | 1.0066 | 0.0828 | 325 | 1.0396 | 0.7981 | 0.7681 | 0.8053 |
66
+ | 1.0534 | 0.0892 | 350 | 1.0360 | 0.8005 | 0.7768 | 0.8113 |
67
+ | 1.0302 | 0.0955 | 375 | 1.0320 | 0.7993 | 0.7754 | 0.8099 |
68
+ | 1.0965 | 0.1019 | 400 | 1.0305 | 0.7988 | 0.7745 | 0.8091 |
69
 
70
 
71
  ### Framework versions
adapter_config.json CHANGED
@@ -20,10 +20,10 @@
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
- "v_proj",
24
- "q_proj",
25
  "k_proj",
26
- "o_proj"
 
 
27
  ],
28
  "task_type": "SEQ_CLS",
29
  "use_dora": false,
 
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
 
 
23
  "k_proj",
24
+ "o_proj",
25
+ "q_proj",
26
+ "v_proj"
27
  ],
28
  "task_type": "SEQ_CLS",
29
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0789a908ecfc7cdc60018ed5a135a610ddf9a4edd3e2dc3aebcfb909c83c39fe
3
- size 578881968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd16b2361941c5bc72f4955f731ac6362dc2d0c5c2146d96d059e1e7e8b15828
3
+ size 578898352