hung200504
/

bert-31

Question Answering

Generated from Trainer

Model card Files Files and versions

hung200504 commited on Oct 19, 2023

Commit

dd01d64

·

1 Parent(s): c256c58

bert-cased

Files changed (3) hide show

README.md +13 -13
pytorch_model.bin +1 -1
training_args.bin +1 -1

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [hung200504/bert-21](https://huggingface.co/hung200504/bert-21) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 11.8463
 ## Model description
@@ -34,7 +34,7 @@ More information needed
 ### Training hyperparameters
 The following hyperparameters were used during training:
-- learning_rate: 3e-07
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
@@ -46,17 +46,17 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 10.907        | 0.09  | 5    | 11.9207         |
-| 11.0539       | 0.18  | 10   | 11.9068         |
-| 10.685        | 0.27  | 15   | 11.8944         |
-| 10.843        | 0.36  | 20   | 11.8840         |
-| 10.8607       | 0.45  | 25   | 11.8741         |
-| 10.9156       | 0.55  | 30   | 11.8658         |
-| 10.2342       | 0.64  | 35   | 11.8593         |
-| 10.8976       | 0.73  | 40   | 11.8541         |
-| 10.4814       | 0.82  | 45   | 11.8501         |
-| 10.4101       | 0.91  | 50   | 11.8476         |
-| 10.2016       | 1.0   | 55   | 11.8463         |
 ### Framework versions

 This model is a fine-tuned version of [hung200504/bert-21](https://huggingface.co/hung200504/bert-21) on an unknown dataset.
 It achieves the following results on the evaluation set:
+- Loss: 11.0679
 ## Model description
 ### Training hyperparameters
 The following hyperparameters were used during training:
+- learning_rate: 3e-06
 - train_batch_size: 16
 - eval_batch_size: 16
 - seed: 42
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
+| 10.8616       | 0.09  | 5    | 11.8092         |
+| 10.8731       | 0.18  | 10   | 11.6719         |
+| 10.3768       | 0.27  | 15   | 11.5476         |
+| 10.4054       | 0.36  | 20   | 11.4385         |
+| 10.3182       | 0.45  | 25   | 11.3427         |
+| 10.2836       | 0.55  | 30   | 11.2612         |
+| 9.5246        | 0.64  | 35   | 11.1941         |
+| 10.1253       | 0.73  | 40   | 11.1418         |
+| 9.6552        | 0.82  | 45   | 11.1033         |
+| 9.5857        | 0.91  | 50   | 11.0784         |
+| 9.3456        | 1.0   | 55   | 11.0679         |
 ### Framework versions

pytorch_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d1e1aca68dfa149485721a2faa5895ba69f274f4df117c59598f5e628739e199
 size 430953062

 version https://git-lfs.github.com/spec/v1
+oid sha256:5ec79298ced3f301ed85684880d89ca934c38a41bb5fdf9d144430c4628198a8
 size 430953062

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b14ab8c21d1947772dde0d11a98ff2919001753f884f0ead1293e00daece1213
 size 4472

 version https://git-lfs.github.com/spec/v1
+oid sha256:5ca7aadc745ee53ed974a31fb356f386cf454bc5cf171e0d7a0195e0d19c52dc
 size 4472