Model save

README.md

@@ -1,6 +1,5 @@
 ---
-license: apache-2.0
-base_model: EleutherAI/polyglot-ko-1.3b
+base_model: klue/roberta-large
 tags:
 - generated_from_trainer
 metrics:
@@ -15,10 +14,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 # reward-gpt
 
-This model is a fine-tuned version of [EleutherAI/polyglot-ko-1.3b](https://huggingface.co/EleutherAI/polyglot-ko-1.3b) on an unknown dataset.
+This model is a fine-tuned version of [klue/roberta-large](https://huggingface.co/klue/roberta-large) on an unknown dataset.
 It achieves the following results on the evaluation set:
 - Loss: 0.0000
-- Accuracy: 0.5
+- Accuracy: 0.0
 
 ## Model description
 
@@ -38,11 +37,11 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 9e-06
-- train_batch_size: 8
-- eval_batch_size: 8
+- train_batch_size: 6
+- eval_batch_size: 6
 - seed: 2023
-- gradient_accumulation_steps: 8
-- total_train_batch_size: 64
+- gradient_accumulation_steps: 10
+- total_train_batch_size: 60
 - optimizer: Adam with betas=(0.9,0.95) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - num_epochs: 1
@@ -51,12 +50,12 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| 0.0554        | 0.16  | 100  | 0.0000          | 0.5      |
-| 0.0356        | 0.33  | 200  | 0.0000          | 0.5      |
-| 0.0741        | 0.49  | 300  | 0.0000          | 0.0      |
-| 0.0399        | 0.65  | 400  | 0.0000          | 0.0      |
-| 0.0307        | 0.81  | 500  | 0.0000          | 0.5      |
-| 0.0331        | 0.98  | 600  | 0.0000          | 0.5      |
+| 0.0808        | 0.15  | 100  | 0.0000          | 0.0      |
+| 0.0682        | 0.3   | 200  | 0.0000          | 0.0      |
+| 0.0718        | 0.46  | 300  | 0.0000          | 0.0      |
+| 0.0579        | 0.61  | 400  | 0.0000          | 0.0      |
+| 0.0557        | 0.76  | 500  | 0.0000          | 0.0      |
+| 0.0458        | 0.91  | 600  | 0.0000          | 0.0      |
 
 
 ### Framework versions

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3d2f74d9bcc8ca2b625c57615e15de06cb5c20bfd7bda4045de13a365ab13ff7
+oid sha256:62de9ff850ddfe83385cd791735b3bc98586feb411a922fe58bb711351b98032
 size 1346765678