lbruderer/rewrite-prompter

README.md

@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [google/gemma-2b-it](https://huggingface.co/google/gemma-2b-it) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.4774
+- Loss: 2.7601
 
 ## Model description
 
@@ -44,16 +44,23 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 10
-- num_epochs: 3
+- num_epochs: 10
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 2.6944        | 1.0   | 15   | 1.6706          |
-| 1.4866        | 2.0   | 30   | 1.4990          |
-| 1.2027        | 3.0   | 45   | 1.4774          |
+| 2.7165        | 1.0   | 15   | 1.7252          |
+| 1.4588        | 2.0   | 30   | 1.5242          |
+| 1.0786        | 3.0   | 45   | 1.5330          |
+| 0.7402        | 4.0   | 60   | 1.6618          |
+| 0.457         | 5.0   | 75   | 1.8911          |
+| 0.2542        | 6.0   | 90   | 2.1658          |
+| 0.1315        | 7.0   | 105  | 2.4128          |
+| 0.0753        | 8.0   | 120  | 2.5541          |
+| 0.0532        | 9.0   | 135  | 2.6873          |
+| 0.0406        | 10.0  | 150  | 2.7601          |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4d6d5871bd1fe379e895f4d7ab3f98eb254abf34d73ab720fc4183bcec883c95
+oid sha256:f5d19b887f6cb8e3012acfce78d8765a48f352bf67211c6772128585345facca
 size 19644664

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6e4e151bc52f4478ff5fdfce20cce1fa30eb35e3cbbb590d697dbc30780fb121
+oid sha256:2bd50c1a643a893be32ccc0b2e5d684b67e31da90730dc4ef4214b536241c1fa
 size 4856