Model save
Browse files- README.md +262 -0
- adapter_model.safetensors +1 -1
README.md
ADDED
|
@@ -0,0 +1,262 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: peft
|
| 3 |
+
license: gemma
|
| 4 |
+
base_model: google/gemma-3-1b-it
|
| 5 |
+
tags:
|
| 6 |
+
- llama-factory
|
| 7 |
+
- generated_from_trainer
|
| 8 |
+
model-index:
|
| 9 |
+
- name: train_qnli_1744902608
|
| 10 |
+
results: []
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 14 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 15 |
+
|
| 16 |
+
# train_qnli_1744902608
|
| 17 |
+
|
| 18 |
+
This model is a fine-tuned version of [google/gemma-3-1b-it](https://huggingface.co/google/gemma-3-1b-it) on an unknown dataset.
|
| 19 |
+
It achieves the following results on the evaluation set:
|
| 20 |
+
- Loss: 0.0682
|
| 21 |
+
- Num Input Tokens Seen: 73102784
|
| 22 |
+
|
| 23 |
+
## Model description
|
| 24 |
+
|
| 25 |
+
More information needed
|
| 26 |
+
|
| 27 |
+
## Intended uses & limitations
|
| 28 |
+
|
| 29 |
+
More information needed
|
| 30 |
+
|
| 31 |
+
## Training and evaluation data
|
| 32 |
+
|
| 33 |
+
More information needed
|
| 34 |
+
|
| 35 |
+
## Training procedure
|
| 36 |
+
|
| 37 |
+
### Training hyperparameters
|
| 38 |
+
|
| 39 |
+
The following hyperparameters were used during training:
|
| 40 |
+
- learning_rate: 5e-05
|
| 41 |
+
- train_batch_size: 4
|
| 42 |
+
- eval_batch_size: 4
|
| 43 |
+
- seed: 123
|
| 44 |
+
- gradient_accumulation_steps: 4
|
| 45 |
+
- total_train_batch_size: 16
|
| 46 |
+
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 47 |
+
- lr_scheduler_type: cosine
|
| 48 |
+
- training_steps: 40000
|
| 49 |
+
|
| 50 |
+
### Training results
|
| 51 |
+
|
| 52 |
+
| Training Loss | Epoch | Step | Validation Loss | Input Tokens Seen |
|
| 53 |
+
|:-------------:|:------:|:-----:|:---------------:|:-----------------:|
|
| 54 |
+
| 0.2201 | 0.0339 | 200 | 0.2234 | 367200 |
|
| 55 |
+
| 0.0726 | 0.0679 | 400 | 0.1261 | 737312 |
|
| 56 |
+
| 0.1142 | 0.1018 | 600 | 0.1096 | 1102816 |
|
| 57 |
+
| 0.0995 | 0.1358 | 800 | 0.1027 | 1468736 |
|
| 58 |
+
| 0.1089 | 0.1697 | 1000 | 0.0995 | 1829952 |
|
| 59 |
+
| 0.0976 | 0.2037 | 1200 | 0.0960 | 2199200 |
|
| 60 |
+
| 0.1023 | 0.2376 | 1400 | 0.0943 | 2565536 |
|
| 61 |
+
| 0.0905 | 0.2716 | 1600 | 0.0933 | 2930336 |
|
| 62 |
+
| 0.0822 | 0.3055 | 1800 | 0.0916 | 3297216 |
|
| 63 |
+
| 0.0795 | 0.3395 | 2000 | 0.0911 | 3666880 |
|
| 64 |
+
| 0.0888 | 0.3734 | 2200 | 0.0895 | 4036544 |
|
| 65 |
+
| 0.0861 | 0.4073 | 2400 | 0.0884 | 4400256 |
|
| 66 |
+
| 0.0998 | 0.4413 | 2600 | 0.0874 | 4765408 |
|
| 67 |
+
| 0.0919 | 0.4752 | 2800 | 0.0871 | 5130336 |
|
| 68 |
+
| 0.068 | 0.5092 | 3000 | 0.0859 | 5495328 |
|
| 69 |
+
| 0.0903 | 0.5431 | 3200 | 0.0853 | 5857280 |
|
| 70 |
+
| 0.1068 | 0.5771 | 3400 | 0.0845 | 6221504 |
|
| 71 |
+
| 0.0682 | 0.6110 | 3600 | 0.0844 | 6589568 |
|
| 72 |
+
| 0.0788 | 0.6450 | 3800 | 0.0847 | 6959584 |
|
| 73 |
+
| 0.0784 | 0.6789 | 4000 | 0.0830 | 7323712 |
|
| 74 |
+
| 0.0992 | 0.7129 | 4200 | 0.0826 | 7690880 |
|
| 75 |
+
| 0.0885 | 0.7468 | 4400 | 0.0821 | 8053632 |
|
| 76 |
+
| 0.0773 | 0.7808 | 4600 | 0.0814 | 8417216 |
|
| 77 |
+
| 0.0824 | 0.8147 | 4800 | 0.0812 | 8782624 |
|
| 78 |
+
| 0.095 | 0.8486 | 5000 | 0.0808 | 9145728 |
|
| 79 |
+
| 0.0875 | 0.8826 | 5200 | 0.0804 | 9513920 |
|
| 80 |
+
| 0.0805 | 0.9165 | 5400 | 0.0801 | 9877152 |
|
| 81 |
+
| 0.0894 | 0.9505 | 5600 | 0.0810 | 10240128 |
|
| 82 |
+
| 0.0881 | 0.9844 | 5800 | 0.0795 | 10606272 |
|
| 83 |
+
| 0.0757 | 1.0183 | 6000 | 0.0790 | 10971744 |
|
| 84 |
+
| 0.0968 | 1.0523 | 6200 | 0.0786 | 11335648 |
|
| 85 |
+
| 0.0803 | 1.0862 | 6400 | 0.0784 | 11702592 |
|
| 86 |
+
| 0.0912 | 1.1202 | 6600 | 0.0783 | 12070112 |
|
| 87 |
+
| 0.0838 | 1.1541 | 6800 | 0.0779 | 12437088 |
|
| 88 |
+
| 0.0695 | 1.1881 | 7000 | 0.0777 | 12802848 |
|
| 89 |
+
| 0.0873 | 1.2220 | 7200 | 0.0773 | 13171040 |
|
| 90 |
+
| 0.071 | 1.2560 | 7400 | 0.0772 | 13539968 |
|
| 91 |
+
| 0.0822 | 1.2899 | 7600 | 0.0766 | 13904864 |
|
| 92 |
+
| 0.0855 | 1.3238 | 7800 | 0.0764 | 14272512 |
|
| 93 |
+
| 0.0872 | 1.3578 | 8000 | 0.0762 | 14634880 |
|
| 94 |
+
| 0.0569 | 1.3917 | 8200 | 0.0767 | 15002592 |
|
| 95 |
+
| 0.0648 | 1.4257 | 8400 | 0.0765 | 15369600 |
|
| 96 |
+
| 0.0498 | 1.4596 | 8600 | 0.0759 | 15731008 |
|
| 97 |
+
| 0.0706 | 1.4936 | 8800 | 0.0754 | 16092896 |
|
| 98 |
+
| 0.0891 | 1.5275 | 9000 | 0.0765 | 16458208 |
|
| 99 |
+
| 0.0686 | 1.5615 | 9200 | 0.0755 | 16823328 |
|
| 100 |
+
| 0.0934 | 1.5954 | 9400 | 0.0752 | 17185120 |
|
| 101 |
+
| 0.0732 | 1.6294 | 9600 | 0.0750 | 17551488 |
|
| 102 |
+
| 0.09 | 1.6633 | 9800 | 0.0746 | 17914752 |
|
| 103 |
+
| 0.0691 | 1.6972 | 10000 | 0.0746 | 18281888 |
|
| 104 |
+
| 0.0782 | 1.7312 | 10200 | 0.0756 | 18645120 |
|
| 105 |
+
| 0.0571 | 1.7651 | 10400 | 0.0743 | 19010848 |
|
| 106 |
+
| 0.0721 | 1.7991 | 10600 | 0.0740 | 19377344 |
|
| 107 |
+
| 0.0702 | 1.8330 | 10800 | 0.0739 | 19739232 |
|
| 108 |
+
| 0.0726 | 1.8670 | 11000 | 0.0738 | 20107584 |
|
| 109 |
+
| 0.0723 | 1.9009 | 11200 | 0.0739 | 20470912 |
|
| 110 |
+
| 0.0832 | 1.9349 | 11400 | 0.0740 | 20832736 |
|
| 111 |
+
| 0.0623 | 1.9688 | 11600 | 0.0735 | 21199808 |
|
| 112 |
+
| 0.0755 | 2.0027 | 11800 | 0.0752 | 21568384 |
|
| 113 |
+
| 0.0663 | 2.0367 | 12000 | 0.0734 | 21931424 |
|
| 114 |
+
| 0.0826 | 2.0706 | 12200 | 0.0731 | 22294816 |
|
| 115 |
+
| 0.0694 | 2.1046 | 12400 | 0.0729 | 22655968 |
|
| 116 |
+
| 0.0674 | 2.1385 | 12600 | 0.0728 | 23020896 |
|
| 117 |
+
| 0.0669 | 2.1724 | 12800 | 0.0726 | 23383104 |
|
| 118 |
+
| 0.0714 | 2.2064 | 13000 | 0.0724 | 23746656 |
|
| 119 |
+
| 0.0577 | 2.2403 | 13200 | 0.0724 | 24110208 |
|
| 120 |
+
| 0.0718 | 2.2743 | 13400 | 0.0722 | 24476544 |
|
| 121 |
+
| 0.0791 | 2.3082 | 13600 | 0.0721 | 24841440 |
|
| 122 |
+
| 0.07 | 2.3422 | 13800 | 0.0732 | 25206624 |
|
| 123 |
+
| 0.0682 | 2.3761 | 14000 | 0.0719 | 25573280 |
|
| 124 |
+
| 0.056 | 2.4101 | 14200 | 0.0719 | 25939392 |
|
| 125 |
+
| 0.0686 | 2.4440 | 14400 | 0.0723 | 26303968 |
|
| 126 |
+
| 0.0684 | 2.4780 | 14600 | 0.0718 | 26666944 |
|
| 127 |
+
| 0.0782 | 2.5119 | 14800 | 0.0716 | 27035136 |
|
| 128 |
+
| 0.0782 | 2.5458 | 15000 | 0.0718 | 27406144 |
|
| 129 |
+
| 0.0678 | 2.5798 | 15200 | 0.0715 | 27772832 |
|
| 130 |
+
| 0.07 | 2.6137 | 15400 | 0.0714 | 28134848 |
|
| 131 |
+
| 0.0579 | 2.6477 | 15600 | 0.0713 | 28505504 |
|
| 132 |
+
| 0.0633 | 2.6816 | 15800 | 0.0712 | 28870784 |
|
| 133 |
+
| 0.0754 | 2.7156 | 16000 | 0.0711 | 29233952 |
|
| 134 |
+
| 0.0688 | 2.7495 | 16200 | 0.0713 | 29603328 |
|
| 135 |
+
| 0.0687 | 2.7835 | 16400 | 0.0714 | 29968768 |
|
| 136 |
+
| 0.0752 | 2.8174 | 16600 | 0.0711 | 30334496 |
|
| 137 |
+
| 0.0626 | 2.8514 | 16800 | 0.0711 | 30703616 |
|
| 138 |
+
| 0.0792 | 2.8853 | 17000 | 0.0713 | 31068224 |
|
| 139 |
+
| 0.0692 | 2.9193 | 17200 | 0.0708 | 31438688 |
|
| 140 |
+
| 0.0602 | 2.9532 | 17400 | 0.0707 | 31802368 |
|
| 141 |
+
| 0.0766 | 2.9871 | 17600 | 0.0704 | 32165728 |
|
| 142 |
+
| 0.0649 | 3.0210 | 17800 | 0.0704 | 32528896 |
|
| 143 |
+
| 0.0758 | 3.0550 | 18000 | 0.0712 | 32897376 |
|
| 144 |
+
| 0.0858 | 3.0889 | 18200 | 0.0705 | 33262688 |
|
| 145 |
+
| 0.0653 | 3.1229 | 18400 | 0.0707 | 33623616 |
|
| 146 |
+
| 0.0722 | 3.1568 | 18600 | 0.0700 | 33989920 |
|
| 147 |
+
| 0.0766 | 3.1908 | 18800 | 0.0701 | 34354528 |
|
| 148 |
+
| 0.0698 | 3.2247 | 19000 | 0.0705 | 34724672 |
|
| 149 |
+
| 0.0852 | 3.2587 | 19200 | 0.0702 | 35092288 |
|
| 150 |
+
| 0.0705 | 3.2926 | 19400 | 0.0703 | 35458048 |
|
| 151 |
+
| 0.0623 | 3.3266 | 19600 | 0.0699 | 35826240 |
|
| 152 |
+
| 0.0656 | 3.3605 | 19800 | 0.0700 | 36191232 |
|
| 153 |
+
| 0.0816 | 3.3944 | 20000 | 0.0700 | 36553088 |
|
| 154 |
+
| 0.059 | 3.4284 | 20200 | 0.0698 | 36917376 |
|
| 155 |
+
| 0.0612 | 3.4623 | 20400 | 0.0698 | 37284512 |
|
| 156 |
+
| 0.0772 | 3.4963 | 20600 | 0.0697 | 37649248 |
|
| 157 |
+
| 0.0608 | 3.5302 | 20800 | 0.0696 | 38012256 |
|
| 158 |
+
| 0.0637 | 3.5642 | 21000 | 0.0696 | 38378592 |
|
| 159 |
+
| 0.0829 | 3.5981 | 21200 | 0.0694 | 38743328 |
|
| 160 |
+
| 0.0668 | 3.6321 | 21400 | 0.0698 | 39111200 |
|
| 161 |
+
| 0.0651 | 3.6660 | 21600 | 0.0693 | 39473536 |
|
| 162 |
+
| 0.0706 | 3.7000 | 21800 | 0.0693 | 39836704 |
|
| 163 |
+
| 0.068 | 3.7339 | 22000 | 0.0701 | 40202176 |
|
| 164 |
+
| 0.0806 | 3.7679 | 22200 | 0.0696 | 40568544 |
|
| 165 |
+
| 0.0671 | 3.8018 | 22400 | 0.0693 | 40932032 |
|
| 166 |
+
| 0.0842 | 3.8357 | 22600 | 0.0694 | 41296544 |
|
| 167 |
+
| 0.0599 | 3.8697 | 22800 | 0.0691 | 41661472 |
|
| 168 |
+
| 0.0818 | 3.9036 | 23000 | 0.0692 | 42031616 |
|
| 169 |
+
| 0.0663 | 3.9376 | 23200 | 0.0690 | 42395200 |
|
| 170 |
+
| 0.054 | 3.9715 | 23400 | 0.0691 | 42760960 |
|
| 171 |
+
| 0.0543 | 4.0054 | 23600 | 0.0690 | 43128480 |
|
| 172 |
+
| 0.0647 | 4.0394 | 23800 | 0.0693 | 43492288 |
|
| 173 |
+
| 0.0523 | 4.0733 | 24000 | 0.0689 | 43859360 |
|
| 174 |
+
| 0.0734 | 4.1073 | 24200 | 0.0688 | 44222400 |
|
| 175 |
+
| 0.0712 | 4.1412 | 24400 | 0.0691 | 44585632 |
|
| 176 |
+
| 0.0492 | 4.1752 | 24600 | 0.0690 | 44956064 |
|
| 177 |
+
| 0.0661 | 4.2091 | 24800 | 0.0688 | 45323456 |
|
| 178 |
+
| 0.0583 | 4.2431 | 25000 | 0.0688 | 45688544 |
|
| 179 |
+
| 0.0682 | 4.2770 | 25200 | 0.0686 | 46054272 |
|
| 180 |
+
| 0.0843 | 4.3109 | 25400 | 0.0687 | 46420608 |
|
| 181 |
+
| 0.0594 | 4.3449 | 25600 | 0.0689 | 46787232 |
|
| 182 |
+
| 0.0622 | 4.3788 | 25800 | 0.0688 | 47151008 |
|
| 183 |
+
| 0.0574 | 4.4128 | 26000 | 0.0690 | 47516064 |
|
| 184 |
+
| 0.0594 | 4.4467 | 26200 | 0.0687 | 47880960 |
|
| 185 |
+
| 0.0698 | 4.4807 | 26400 | 0.0686 | 48244480 |
|
| 186 |
+
| 0.0468 | 4.5146 | 26600 | 0.0688 | 48612352 |
|
| 187 |
+
| 0.0469 | 4.5486 | 26800 | 0.0688 | 48977376 |
|
| 188 |
+
| 0.0529 | 4.5825 | 27000 | 0.0685 | 49343328 |
|
| 189 |
+
| 0.0649 | 4.6165 | 27200 | 0.0685 | 49712064 |
|
| 190 |
+
| 0.0805 | 4.6504 | 27400 | 0.0685 | 50076832 |
|
| 191 |
+
| 0.0531 | 4.6843 | 27600 | 0.0683 | 50439616 |
|
| 192 |
+
| 0.0733 | 4.7183 | 27800 | 0.0686 | 50803552 |
|
| 193 |
+
| 0.0751 | 4.7522 | 28000 | 0.0685 | 51165472 |
|
| 194 |
+
| 0.0621 | 4.7862 | 28200 | 0.0684 | 51527808 |
|
| 195 |
+
| 0.0636 | 4.8201 | 28400 | 0.0683 | 51895200 |
|
| 196 |
+
| 0.064 | 4.8541 | 28600 | 0.0683 | 52259648 |
|
| 197 |
+
| 0.0755 | 4.8880 | 28800 | 0.0684 | 52628032 |
|
| 198 |
+
| 0.0781 | 4.9220 | 29000 | 0.0684 | 52997024 |
|
| 199 |
+
| 0.083 | 4.9559 | 29200 | 0.0684 | 53364352 |
|
| 200 |
+
| 0.0688 | 4.9899 | 29400 | 0.0684 | 53730624 |
|
| 201 |
+
| 0.0806 | 5.0238 | 29600 | 0.0683 | 54094208 |
|
| 202 |
+
| 0.0654 | 5.0577 | 29800 | 0.0682 | 54461312 |
|
| 203 |
+
| 0.066 | 5.0917 | 30000 | 0.0685 | 54825216 |
|
| 204 |
+
| 0.0505 | 5.1256 | 30200 | 0.0685 | 55189504 |
|
| 205 |
+
| 0.0719 | 5.1595 | 30400 | 0.0682 | 55553280 |
|
| 206 |
+
| 0.0674 | 5.1935 | 30600 | 0.0683 | 55917792 |
|
| 207 |
+
| 0.072 | 5.2274 | 30800 | 0.0683 | 56282176 |
|
| 208 |
+
| 0.0495 | 5.2614 | 31000 | 0.0684 | 56643104 |
|
| 209 |
+
| 0.0575 | 5.2953 | 31200 | 0.0690 | 57005120 |
|
| 210 |
+
| 0.0511 | 5.3293 | 31400 | 0.0683 | 57373152 |
|
| 211 |
+
| 0.0483 | 5.3632 | 31600 | 0.0684 | 57735872 |
|
| 212 |
+
| 0.0635 | 5.3972 | 31800 | 0.0682 | 58101536 |
|
| 213 |
+
| 0.0946 | 5.4311 | 32000 | 0.0683 | 58472288 |
|
| 214 |
+
| 0.0701 | 5.4651 | 32200 | 0.0681 | 58840960 |
|
| 215 |
+
| 0.0785 | 5.4990 | 32400 | 0.0685 | 59204992 |
|
| 216 |
+
| 0.0741 | 5.5329 | 32600 | 0.0681 | 59570752 |
|
| 217 |
+
| 0.0594 | 5.5669 | 32800 | 0.0680 | 59937728 |
|
| 218 |
+
| 0.0511 | 5.6008 | 33000 | 0.0683 | 60306240 |
|
| 219 |
+
| 0.0809 | 5.6348 | 33200 | 0.0681 | 60675168 |
|
| 220 |
+
| 0.0648 | 5.6687 | 33400 | 0.0682 | 61042176 |
|
| 221 |
+
| 0.0818 | 5.7027 | 33600 | 0.0681 | 61409120 |
|
| 222 |
+
| 0.0697 | 5.7366 | 33800 | 0.0678 | 61775168 |
|
| 223 |
+
| 0.0437 | 5.7706 | 34000 | 0.0682 | 62143616 |
|
| 224 |
+
| 0.0819 | 5.8045 | 34200 | 0.0681 | 62507552 |
|
| 225 |
+
| 0.0636 | 5.8385 | 34400 | 0.0680 | 62872928 |
|
| 226 |
+
| 0.0748 | 5.8724 | 34600 | 0.0680 | 63234816 |
|
| 227 |
+
| 0.0511 | 5.9064 | 34800 | 0.0680 | 63599616 |
|
| 228 |
+
| 0.08 | 5.9403 | 35000 | 0.0681 | 63966688 |
|
| 229 |
+
| 0.053 | 5.9742 | 35200 | 0.0680 | 64332704 |
|
| 230 |
+
| 0.0796 | 6.0081 | 35400 | 0.0680 | 64693664 |
|
| 231 |
+
| 0.0642 | 6.0421 | 35600 | 0.0682 | 65053728 |
|
| 232 |
+
| 0.0656 | 6.0760 | 35800 | 0.0681 | 65419648 |
|
| 233 |
+
| 0.0789 | 6.1100 | 36000 | 0.0679 | 65786464 |
|
| 234 |
+
| 0.0648 | 6.1439 | 36200 | 0.0681 | 66152416 |
|
| 235 |
+
| 0.0629 | 6.1779 | 36400 | 0.0681 | 66522528 |
|
| 236 |
+
| 0.0629 | 6.2118 | 36600 | 0.0681 | 66888512 |
|
| 237 |
+
| 0.0565 | 6.2458 | 36800 | 0.0681 | 67255840 |
|
| 238 |
+
| 0.0591 | 6.2797 | 37000 | 0.0681 | 67620416 |
|
| 239 |
+
| 0.0556 | 6.3137 | 37200 | 0.0681 | 67983360 |
|
| 240 |
+
| 0.0514 | 6.3476 | 37400 | 0.0682 | 68348480 |
|
| 241 |
+
| 0.07 | 6.3816 | 37600 | 0.0679 | 68715840 |
|
| 242 |
+
| 0.0543 | 6.4155 | 37800 | 0.0681 | 69081536 |
|
| 243 |
+
| 0.0887 | 6.4494 | 38000 | 0.0680 | 69446208 |
|
| 244 |
+
| 0.051 | 6.4834 | 38200 | 0.0680 | 69813728 |
|
| 245 |
+
| 0.0644 | 6.5173 | 38400 | 0.0680 | 70182464 |
|
| 246 |
+
| 0.0457 | 6.5513 | 38600 | 0.0682 | 70547904 |
|
| 247 |
+
| 0.0766 | 6.5852 | 38800 | 0.0680 | 70911456 |
|
| 248 |
+
| 0.0701 | 6.6192 | 39000 | 0.0681 | 71277536 |
|
| 249 |
+
| 0.0563 | 6.6531 | 39200 | 0.0680 | 71642624 |
|
| 250 |
+
| 0.0755 | 6.6871 | 39400 | 0.0680 | 72006592 |
|
| 251 |
+
| 0.0527 | 6.7210 | 39600 | 0.0681 | 72370176 |
|
| 252 |
+
| 0.062 | 6.7550 | 39800 | 0.0682 | 72737088 |
|
| 253 |
+
| 0.0616 | 6.7889 | 40000 | 0.0682 | 73102784 |
|
| 254 |
+
|
| 255 |
+
|
| 256 |
+
### Framework versions
|
| 257 |
+
|
| 258 |
+
- PEFT 0.15.1
|
| 259 |
+
- Transformers 4.51.3
|
| 260 |
+
- Pytorch 2.6.0+cu124
|
| 261 |
+
- Datasets 3.5.0
|
| 262 |
+
- Tokenizers 0.21.1
|
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 498936
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b7eed9d6345781b66b1ce8ca741dfae026ee1fb6f317bcf91469ae2056ee2528
|
| 3 |
size 498936
|