Model save
Browse files- README.md +264 -0
- adapter_model.safetensors +1 -1
README.md
ADDED
|
@@ -0,0 +1,264 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: peft
|
| 3 |
+
license: gemma
|
| 4 |
+
base_model: google/gemma-3-1b-it
|
| 5 |
+
tags:
|
| 6 |
+
- llama-factory
|
| 7 |
+
- generated_from_trainer
|
| 8 |
+
datasets:
|
| 9 |
+
- super_glue
|
| 10 |
+
model-index:
|
| 11 |
+
- name: train_cb_1745950308
|
| 12 |
+
results: []
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 16 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 17 |
+
|
| 18 |
+
# train_cb_1745950308
|
| 19 |
+
|
| 20 |
+
This model is a fine-tuned version of [google/gemma-3-1b-it](https://huggingface.co/google/gemma-3-1b-it) on the super_glue dataset.
|
| 21 |
+
It achieves the following results on the evaluation set:
|
| 22 |
+
- Loss: 0.7024
|
| 23 |
+
- Num Input Tokens Seen: 22718312
|
| 24 |
+
|
| 25 |
+
## Model description
|
| 26 |
+
|
| 27 |
+
More information needed
|
| 28 |
+
|
| 29 |
+
## Intended uses & limitations
|
| 30 |
+
|
| 31 |
+
More information needed
|
| 32 |
+
|
| 33 |
+
## Training and evaluation data
|
| 34 |
+
|
| 35 |
+
More information needed
|
| 36 |
+
|
| 37 |
+
## Training procedure
|
| 38 |
+
|
| 39 |
+
### Training hyperparameters
|
| 40 |
+
|
| 41 |
+
The following hyperparameters were used during training:
|
| 42 |
+
- learning_rate: 5e-05
|
| 43 |
+
- train_batch_size: 2
|
| 44 |
+
- eval_batch_size: 2
|
| 45 |
+
- seed: 123
|
| 46 |
+
- gradient_accumulation_steps: 2
|
| 47 |
+
- total_train_batch_size: 4
|
| 48 |
+
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 49 |
+
- lr_scheduler_type: cosine
|
| 50 |
+
- training_steps: 40000
|
| 51 |
+
|
| 52 |
+
### Training results
|
| 53 |
+
|
| 54 |
+
| Training Loss | Epoch | Step | Validation Loss | Input Tokens Seen |
|
| 55 |
+
|:-------------:|:--------:|:-----:|:---------------:|:-----------------:|
|
| 56 |
+
| 0.6391 | 3.5133 | 200 | 0.5417 | 114504 |
|
| 57 |
+
| 0.4911 | 7.0177 | 400 | 0.3985 | 228504 |
|
| 58 |
+
| 0.3148 | 10.5310 | 600 | 0.3381 | 341136 |
|
| 59 |
+
| 0.265 | 14.0354 | 800 | 0.2901 | 455488 |
|
| 60 |
+
| 0.1024 | 17.5487 | 1000 | 0.2637 | 569504 |
|
| 61 |
+
| 0.1238 | 21.0531 | 1200 | 0.2477 | 682024 |
|
| 62 |
+
| 0.0141 | 24.5664 | 1400 | 0.2390 | 796328 |
|
| 63 |
+
| 0.0747 | 28.0708 | 1600 | 0.2173 | 909320 |
|
| 64 |
+
| 0.0455 | 31.5841 | 1800 | 0.2249 | 1023696 |
|
| 65 |
+
| 0.0653 | 35.0885 | 2000 | 0.2210 | 1137280 |
|
| 66 |
+
| 0.0144 | 38.6018 | 2200 | 0.2023 | 1251592 |
|
| 67 |
+
| 0.0855 | 42.1062 | 2400 | 0.2247 | 1364312 |
|
| 68 |
+
| 0.0183 | 45.6195 | 2600 | 0.2138 | 1478704 |
|
| 69 |
+
| 0.0104 | 49.1239 | 2800 | 0.2256 | 1591424 |
|
| 70 |
+
| 0.0089 | 52.6372 | 3000 | 0.2304 | 1705000 |
|
| 71 |
+
| 0.0743 | 56.1416 | 3200 | 0.2253 | 1818688 |
|
| 72 |
+
| 0.013 | 59.6549 | 3400 | 0.2388 | 1932248 |
|
| 73 |
+
| 0.0327 | 63.1593 | 3600 | 0.2343 | 2045464 |
|
| 74 |
+
| 0.0439 | 66.6726 | 3800 | 0.2679 | 2159128 |
|
| 75 |
+
| 0.0082 | 70.1770 | 4000 | 0.2531 | 2272792 |
|
| 76 |
+
| 0.0034 | 73.6903 | 4200 | 0.2519 | 2387344 |
|
| 77 |
+
| 0.0178 | 77.1947 | 4400 | 0.2620 | 2500160 |
|
| 78 |
+
| 0.0041 | 80.7080 | 4600 | 0.2711 | 2614032 |
|
| 79 |
+
| 0.0022 | 84.2124 | 4800 | 0.2904 | 2728488 |
|
| 80 |
+
| 0.0011 | 87.7257 | 5000 | 0.3025 | 2842656 |
|
| 81 |
+
| 0.0033 | 91.2301 | 5200 | 0.2947 | 2956824 |
|
| 82 |
+
| 0.0015 | 94.7434 | 5400 | 0.3044 | 3069840 |
|
| 83 |
+
| 0.0035 | 98.2478 | 5600 | 0.3178 | 3183600 |
|
| 84 |
+
| 0.0017 | 101.7611 | 5800 | 0.3312 | 3297896 |
|
| 85 |
+
| 0.0004 | 105.2655 | 6000 | 0.3405 | 3411544 |
|
| 86 |
+
| 0.0011 | 108.7788 | 6200 | 0.3566 | 3525472 |
|
| 87 |
+
| 0.0005 | 112.2832 | 6400 | 0.3447 | 3638584 |
|
| 88 |
+
| 0.001 | 115.7965 | 6600 | 0.3534 | 3752608 |
|
| 89 |
+
| 0.0005 | 119.3009 | 6800 | 0.3653 | 3865376 |
|
| 90 |
+
| 0.0005 | 122.8142 | 7000 | 0.3451 | 3979464 |
|
| 91 |
+
| 0.0005 | 126.3186 | 7200 | 0.3638 | 4093296 |
|
| 92 |
+
| 0.0003 | 129.8319 | 7400 | 0.3652 | 4207120 |
|
| 93 |
+
| 0.0003 | 133.3363 | 7600 | 0.3779 | 4320568 |
|
| 94 |
+
| 0.0001 | 136.8496 | 7800 | 0.3726 | 4434056 |
|
| 95 |
+
| 0.0002 | 140.3540 | 8000 | 0.3781 | 4547840 |
|
| 96 |
+
| 0.0002 | 143.8673 | 8200 | 0.3936 | 4662192 |
|
| 97 |
+
| 0.0002 | 147.3717 | 8400 | 0.3909 | 4774160 |
|
| 98 |
+
| 0.0001 | 150.8850 | 8600 | 0.3995 | 4887640 |
|
| 99 |
+
| 0.0001 | 154.3894 | 8800 | 0.4058 | 5002864 |
|
| 100 |
+
| 0.0001 | 157.9027 | 9000 | 0.4136 | 5116216 |
|
| 101 |
+
| 0.0001 | 161.4071 | 9200 | 0.4089 | 5229496 |
|
| 102 |
+
| 0.0001 | 164.9204 | 9400 | 0.4107 | 5343528 |
|
| 103 |
+
| 0.0001 | 168.4248 | 9600 | 0.4285 | 5455520 |
|
| 104 |
+
| 0.0001 | 171.9381 | 9800 | 0.4210 | 5571144 |
|
| 105 |
+
| 0.0 | 175.4425 | 10000 | 0.4252 | 5684752 |
|
| 106 |
+
| 0.0001 | 178.9558 | 10200 | 0.4359 | 5799088 |
|
| 107 |
+
| 0.0 | 182.4602 | 10400 | 0.4257 | 5911888 |
|
| 108 |
+
| 0.0 | 185.9735 | 10600 | 0.4229 | 6025544 |
|
| 109 |
+
| 0.0 | 189.4779 | 10800 | 0.4261 | 6139264 |
|
| 110 |
+
| 0.0 | 192.9912 | 11000 | 0.4383 | 6252832 |
|
| 111 |
+
| 0.0 | 196.4956 | 11200 | 0.4593 | 6366440 |
|
| 112 |
+
| 0.0 | 200.0 | 11400 | 0.4587 | 6478776 |
|
| 113 |
+
| 0.0 | 203.5133 | 11600 | 0.4423 | 6592280 |
|
| 114 |
+
| 0.0 | 207.0177 | 11800 | 0.4542 | 6704968 |
|
| 115 |
+
| 0.0 | 210.5310 | 12000 | 0.4529 | 6819568 |
|
| 116 |
+
| 0.0 | 214.0354 | 12200 | 0.4446 | 6933264 |
|
| 117 |
+
| 0.0 | 217.5487 | 12400 | 0.4566 | 7045688 |
|
| 118 |
+
| 0.0 | 221.0531 | 12600 | 0.4661 | 7159888 |
|
| 119 |
+
| 0.0 | 224.5664 | 12800 | 0.4743 | 7274296 |
|
| 120 |
+
| 0.0 | 228.0708 | 13000 | 0.4834 | 7387544 |
|
| 121 |
+
| 0.0 | 231.5841 | 13200 | 0.4638 | 7500200 |
|
| 122 |
+
| 0.0 | 235.0885 | 13400 | 0.4666 | 7614696 |
|
| 123 |
+
| 0.0 | 238.6018 | 13600 | 0.4755 | 7727608 |
|
| 124 |
+
| 0.0 | 242.1062 | 13800 | 0.4843 | 7840696 |
|
| 125 |
+
| 0.0 | 245.6195 | 14000 | 0.4933 | 7954632 |
|
| 126 |
+
| 0.0 | 249.1239 | 14200 | 0.4881 | 8068648 |
|
| 127 |
+
| 0.0 | 252.6372 | 14400 | 0.5147 | 8181840 |
|
| 128 |
+
| 0.0 | 256.1416 | 14600 | 0.4881 | 8294896 |
|
| 129 |
+
| 0.0 | 259.6549 | 14800 | 0.5142 | 8408512 |
|
| 130 |
+
| 0.0 | 263.1593 | 15000 | 0.4932 | 8522664 |
|
| 131 |
+
| 0.0 | 266.6726 | 15200 | 0.4977 | 8636032 |
|
| 132 |
+
| 0.0 | 270.1770 | 15400 | 0.5226 | 8748624 |
|
| 133 |
+
| 0.0 | 273.6903 | 15600 | 0.5147 | 8863248 |
|
| 134 |
+
| 0.0 | 277.1947 | 15800 | 0.5117 | 8976424 |
|
| 135 |
+
| 0.0 | 280.7080 | 16000 | 0.5130 | 9088984 |
|
| 136 |
+
| 0.0 | 284.2124 | 16200 | 0.5174 | 9204128 |
|
| 137 |
+
| 0.0 | 287.7257 | 16400 | 0.5122 | 9317208 |
|
| 138 |
+
| 0.0 | 291.2301 | 16600 | 0.5242 | 9431208 |
|
| 139 |
+
| 0.0 | 294.7434 | 16800 | 0.5225 | 9544328 |
|
| 140 |
+
| 0.0 | 298.2478 | 17000 | 0.5478 | 9657432 |
|
| 141 |
+
| 0.0 | 301.7611 | 17200 | 0.5591 | 9770824 |
|
| 142 |
+
| 0.0 | 305.2655 | 17400 | 0.5156 | 9884648 |
|
| 143 |
+
| 0.0 | 308.7788 | 17600 | 0.5336 | 9997288 |
|
| 144 |
+
| 0.0 | 312.2832 | 17800 | 0.5303 | 10111472 |
|
| 145 |
+
| 0.0 | 315.7965 | 18000 | 0.5557 | 10223648 |
|
| 146 |
+
| 0.0 | 319.3009 | 18200 | 0.5313 | 10336864 |
|
| 147 |
+
| 0.0 | 322.8142 | 18400 | 0.5492 | 10450688 |
|
| 148 |
+
| 0.0 | 326.3186 | 18600 | 0.5344 | 10563128 |
|
| 149 |
+
| 0.0 | 329.8319 | 18800 | 0.5433 | 10677928 |
|
| 150 |
+
| 0.0 | 333.3363 | 19000 | 0.5773 | 10790896 |
|
| 151 |
+
| 0.0 | 336.8496 | 19200 | 0.5537 | 10904600 |
|
| 152 |
+
| 0.0 | 340.3540 | 19400 | 0.5574 | 11018112 |
|
| 153 |
+
| 0.0 | 343.8673 | 19600 | 0.5366 | 11131712 |
|
| 154 |
+
| 0.0 | 347.3717 | 19800 | 0.5600 | 11245728 |
|
| 155 |
+
| 0.0 | 350.8850 | 20000 | 0.5699 | 11358800 |
|
| 156 |
+
| 0.0 | 354.3894 | 20200 | 0.5486 | 11471832 |
|
| 157 |
+
| 0.0 | 357.9027 | 20400 | 0.5586 | 11586368 |
|
| 158 |
+
| 0.0 | 361.4071 | 20600 | 0.5623 | 11700176 |
|
| 159 |
+
| 0.0 | 364.9204 | 20800 | 0.5771 | 11814304 |
|
| 160 |
+
| 0.0 | 368.4248 | 21000 | 0.5425 | 11927464 |
|
| 161 |
+
| 0.0 | 371.9381 | 21200 | 0.5818 | 12041416 |
|
| 162 |
+
| 0.0 | 375.4425 | 21400 | 0.5916 | 12153176 |
|
| 163 |
+
| 0.0 | 378.9558 | 21600 | 0.5889 | 12267984 |
|
| 164 |
+
| 0.0 | 382.4602 | 21800 | 0.5943 | 12381424 |
|
| 165 |
+
| 0.0 | 385.9735 | 22000 | 0.5870 | 12494280 |
|
| 166 |
+
| 0.0 | 389.4779 | 22200 | 0.5731 | 12608008 |
|
| 167 |
+
| 0.0 | 392.9912 | 22400 | 0.6058 | 12721456 |
|
| 168 |
+
| 0.0 | 396.4956 | 22600 | 0.5977 | 12835240 |
|
| 169 |
+
| 0.0 | 400.0 | 22800 | 0.6147 | 12948416 |
|
| 170 |
+
| 0.0 | 403.5133 | 23000 | 0.6086 | 13061472 |
|
| 171 |
+
| 0.0 | 407.0177 | 23200 | 0.6105 | 13175888 |
|
| 172 |
+
| 0.0 | 410.5310 | 23400 | 0.6152 | 13289752 |
|
| 173 |
+
| 0.0 | 414.0354 | 23600 | 0.6163 | 13403848 |
|
| 174 |
+
| 0.0 | 417.5487 | 23800 | 0.6257 | 13518496 |
|
| 175 |
+
| 0.0 | 421.0531 | 24000 | 0.5990 | 13631704 |
|
| 176 |
+
| 0.0 | 424.5664 | 24200 | 0.5993 | 13745200 |
|
| 177 |
+
| 0.0 | 428.0708 | 24400 | 0.6045 | 13859752 |
|
| 178 |
+
| 0.0 | 431.5841 | 24600 | 0.6135 | 13972648 |
|
| 179 |
+
| 0.0 | 435.0885 | 24800 | 0.6303 | 14086360 |
|
| 180 |
+
| 0.0 | 438.6018 | 25000 | 0.6207 | 14201656 |
|
| 181 |
+
| 0.0 | 442.1062 | 25200 | 0.6126 | 14314736 |
|
| 182 |
+
| 0.0 | 445.6195 | 25400 | 0.6147 | 14428104 |
|
| 183 |
+
| 0.0 | 449.1239 | 25600 | 0.6082 | 14541136 |
|
| 184 |
+
| 0.0 | 452.6372 | 25800 | 0.6216 | 14655696 |
|
| 185 |
+
| 0.0 | 456.1416 | 26000 | 0.6219 | 14768168 |
|
| 186 |
+
| 0.0 | 459.6549 | 26200 | 0.6315 | 14882048 |
|
| 187 |
+
| 0.0 | 463.1593 | 26400 | 0.6396 | 14996008 |
|
| 188 |
+
| 0.0 | 466.6726 | 26600 | 0.6411 | 15109352 |
|
| 189 |
+
| 0.0 | 470.1770 | 26800 | 0.6570 | 15223592 |
|
| 190 |
+
| 0.0 | 473.6903 | 27000 | 0.6647 | 15338072 |
|
| 191 |
+
| 0.0 | 477.1947 | 27200 | 0.6556 | 15451312 |
|
| 192 |
+
| 0.0 | 480.7080 | 27400 | 0.6473 | 15565784 |
|
| 193 |
+
| 0.0 | 484.2124 | 27600 | 0.6647 | 15679720 |
|
| 194 |
+
| 0.0 | 487.7257 | 27800 | 0.6632 | 15792680 |
|
| 195 |
+
| 0.0 | 491.2301 | 28000 | 0.6731 | 15906624 |
|
| 196 |
+
| 0.0 | 494.7434 | 28200 | 0.6559 | 16019936 |
|
| 197 |
+
| 0.0 | 498.2478 | 28400 | 0.6320 | 16133784 |
|
| 198 |
+
| 0.0 | 501.7611 | 28600 | 0.6781 | 16248200 |
|
| 199 |
+
| 0.0 | 505.2655 | 28800 | 0.6782 | 16361560 |
|
| 200 |
+
| 0.0 | 508.7788 | 29000 | 0.6502 | 16475624 |
|
| 201 |
+
| 0.0 | 512.2832 | 29200 | 0.6390 | 16588984 |
|
| 202 |
+
| 0.0 | 515.7965 | 29400 | 0.6706 | 16702496 |
|
| 203 |
+
| 0.0 | 519.3009 | 29600 | 0.6885 | 16816272 |
|
| 204 |
+
| 0.0 | 522.8142 | 29800 | 0.6672 | 16929072 |
|
| 205 |
+
| 0.0 | 526.3186 | 30000 | 0.6908 | 17043120 |
|
| 206 |
+
| 0.0 | 529.8319 | 30200 | 0.7010 | 17156344 |
|
| 207 |
+
| 0.0 | 533.3363 | 30400 | 0.7022 | 17268656 |
|
| 208 |
+
| 0.0 | 536.8496 | 30600 | 0.6844 | 17383696 |
|
| 209 |
+
| 0.0 | 540.3540 | 30800 | 0.6849 | 17495648 |
|
| 210 |
+
| 0.0 | 543.8673 | 31000 | 0.7018 | 17609616 |
|
| 211 |
+
| 0.0 | 547.3717 | 31200 | 0.6727 | 17723600 |
|
| 212 |
+
| 0.0 | 550.8850 | 31400 | 0.6931 | 17836576 |
|
| 213 |
+
| 0.0 | 554.3894 | 31600 | 0.6648 | 17949928 |
|
| 214 |
+
| 0.0 | 557.9027 | 31800 | 0.6720 | 18064576 |
|
| 215 |
+
| 0.0 | 561.4071 | 32000 | 0.6760 | 18177096 |
|
| 216 |
+
| 0.0 | 564.9204 | 32200 | 0.6887 | 18290608 |
|
| 217 |
+
| 0.0 | 568.4248 | 32400 | 0.7023 | 18404648 |
|
| 218 |
+
| 0.0 | 571.9381 | 32600 | 0.6980 | 18517216 |
|
| 219 |
+
| 0.0 | 575.4425 | 32800 | 0.6711 | 18631296 |
|
| 220 |
+
| 0.0 | 578.9558 | 33000 | 0.6660 | 18745416 |
|
| 221 |
+
| 0.0 | 582.4602 | 33200 | 0.6717 | 18857896 |
|
| 222 |
+
| 0.0 | 585.9735 | 33400 | 0.6783 | 18971344 |
|
| 223 |
+
| 0.0 | 589.4779 | 33600 | 0.6766 | 19085248 |
|
| 224 |
+
| 0.0 | 592.9912 | 33800 | 0.6796 | 19199136 |
|
| 225 |
+
| 0.0 | 596.4956 | 34000 | 0.7248 | 19311344 |
|
| 226 |
+
| 0.0 | 600.0 | 34200 | 0.6982 | 19425472 |
|
| 227 |
+
| 0.0 | 603.5133 | 34400 | 0.6736 | 19539112 |
|
| 228 |
+
| 0.0 | 607.0177 | 34600 | 0.6695 | 19652392 |
|
| 229 |
+
| 0.0 | 610.5310 | 34800 | 0.7022 | 19766904 |
|
| 230 |
+
| 0.0 | 614.0354 | 35000 | 0.6896 | 19879808 |
|
| 231 |
+
| 0.0 | 617.5487 | 35200 | 0.6923 | 19993952 |
|
| 232 |
+
| 0.0 | 621.0531 | 35400 | 0.7184 | 20107560 |
|
| 233 |
+
| 0.0 | 624.5664 | 35600 | 0.6938 | 20220888 |
|
| 234 |
+
| 0.0 | 628.0708 | 35800 | 0.7055 | 20333904 |
|
| 235 |
+
| 0.0 | 631.5841 | 36000 | 0.6938 | 20446736 |
|
| 236 |
+
| 0.0 | 635.0885 | 36200 | 0.7019 | 20560472 |
|
| 237 |
+
| 0.0 | 638.6018 | 36400 | 0.6990 | 20673984 |
|
| 238 |
+
| 0.0 | 642.1062 | 36600 | 0.6915 | 20786240 |
|
| 239 |
+
| 0.0 | 645.6195 | 36800 | 0.6995 | 20899128 |
|
| 240 |
+
| 0.0 | 649.1239 | 37000 | 0.7121 | 21011928 |
|
| 241 |
+
| 0.0 | 652.6372 | 37200 | 0.7113 | 21126880 |
|
| 242 |
+
| 0.0 | 656.1416 | 37400 | 0.6808 | 21239760 |
|
| 243 |
+
| 0.0 | 659.6549 | 37600 | 0.6962 | 21353776 |
|
| 244 |
+
| 0.0 | 663.1593 | 37800 | 0.6780 | 21467368 |
|
| 245 |
+
| 0.0 | 666.6726 | 38000 | 0.6750 | 21581512 |
|
| 246 |
+
| 0.0 | 670.1770 | 38200 | 0.6950 | 21694376 |
|
| 247 |
+
| 0.0 | 673.6903 | 38400 | 0.6880 | 21808568 |
|
| 248 |
+
| 0.0 | 677.1947 | 38600 | 0.6614 | 21922424 |
|
| 249 |
+
| 0.0 | 680.7080 | 38800 | 0.7017 | 22036600 |
|
| 250 |
+
| 0.0 | 684.2124 | 39000 | 0.7000 | 22150992 |
|
| 251 |
+
| 0.0 | 687.7257 | 39200 | 0.7024 | 22263616 |
|
| 252 |
+
| 0.0 | 691.2301 | 39400 | 0.7024 | 22377936 |
|
| 253 |
+
| 0.0 | 694.7434 | 39600 | 0.7024 | 22490328 |
|
| 254 |
+
| 0.0 | 698.2478 | 39800 | 0.7024 | 22604096 |
|
| 255 |
+
| 0.0 | 701.7611 | 40000 | 0.7024 | 22718312 |
|
| 256 |
+
|
| 257 |
+
|
| 258 |
+
### Framework versions
|
| 259 |
+
|
| 260 |
+
- PEFT 0.15.2.dev0
|
| 261 |
+
- Transformers 4.51.3
|
| 262 |
+
- Pytorch 2.6.0+cu124
|
| 263 |
+
- Datasets 3.5.0
|
| 264 |
+
- Tokenizers 0.21.1
|
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 182352
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ebcd57e714bd97ce34e82601346dcab5d5b701cec96240999df41b2408076e6d
|
| 3 |
size 182352
|