Upload model

README.md

@@ -8,6 +8,7 @@ metrics:
 model-index:
 - name: distilbert-base-uncased-lora-text-classification
   results: []
+library_name: peft
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -17,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.8055
-- Accuracy: {'accuracy': 0.899}
+- Loss: 1.0680
+- Accuracy: {'accuracy': 0.885}
 
 ## Model description
 
@@ -49,20 +50,21 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy            |
 |:-------------:|:-----:|:----:|:---------------:|:-------------------:|
-| No log        | 1.0   | 250  | 0.3610          | {'accuracy': 0.876} |
-| 0.437         | 2.0   | 500  | 0.3404          | {'accuracy': 0.881} |
-| 0.437         | 3.0   | 750  | 0.3917          | {'accuracy': 0.889} |
-| 0.2122        | 4.0   | 1000 | 0.5645          | {'accuracy': 0.889} |
-| 0.2122        | 5.0   | 1250 | 0.6694          | {'accuracy': 0.889} |
-| 0.0594        | 6.0   | 1500 | 0.7044          | {'accuracy': 0.903} |
-| 0.0594        | 7.0   | 1750 | 0.7941          | {'accuracy': 0.892} |
-| 0.0215        | 8.0   | 2000 | 0.7413          | {'accuracy': 0.899} |
-| 0.0215        | 9.0   | 2250 | 0.8056          | {'accuracy': 0.895} |
-| 0.0074        | 10.0  | 2500 | 0.8055          | {'accuracy': 0.899} |
+| No log        | 1.0   | 250  | 0.3690          | {'accuracy': 0.87}  |
+| 0.3946        | 2.0   | 500  | 0.5006          | {'accuracy': 0.849} |
+| 0.3946        | 3.0   | 750  | 0.5917          | {'accuracy': 0.865} |
+| 0.1803        | 4.0   | 1000 | 0.7957          | {'accuracy': 0.868} |
+| 0.1803        | 5.0   | 1250 | 0.7798          | {'accuracy': 0.872} |
+| 0.0779        | 6.0   | 1500 | 0.9091          | {'accuracy': 0.877} |
+| 0.0779        | 7.0   | 1750 | 1.0116          | {'accuracy': 0.877} |
+| 0.0156        | 8.0   | 2000 | 1.1076          | {'accuracy': 0.872} |
+| 0.0156        | 9.0   | 2250 | 1.0598          | {'accuracy': 0.885} |
+| 0.0085        | 10.0  | 2500 | 1.0680          | {'accuracy': 0.885} |
 
 
 ### Framework versions
 
+- PEFT 0.5.0
 - Transformers 4.32.1
 - Pytorch 2.1.0.dev20230905
 - Datasets 2.14.4

adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:50da83a6936996749cdc931a4033e5f40b2fcafdfe778424f965cd909f7edcd1
-size 2522142
+oid sha256:6ad39a29aa167dd1793c156e17da692f4330e98cbeb6ecf5ac1c24fbbbb231be
+size 2521633