Training in progress, epoch 1

README.md

@@ -1,6 +1,7 @@
 ---
 library_name: transformers
-base_model: monsoon-nlp/bert-base-thai
+license: apache-2.0
+base_model: Geotrend/bert-base-th-cased
 tags:
 - generated_from_trainer
 metrics:
@@ -9,22 +10,22 @@ metrics:
 - precision
 - recall
 model-index:
-- name: bert-base-thai-intent-booking
+- name: bert-base-th-cased-intent-booking
   results: []
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-# bert-base-thai-intent-booking
+# bert-base-th-cased-intent-booking
 
-This model is a fine-tuned version of [monsoon-nlp/bert-base-thai](https://huggingface.co/monsoon-nlp/bert-base-thai) on an unknown dataset.
+This model is a fine-tuned version of [Geotrend/bert-base-th-cased](https://huggingface.co/Geotrend/bert-base-th-cased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.1536
-- Accuracy: 0.1982
-- F1: 0.1700
-- Precision: 0.2287
-- Recall: 0.1982
+- Loss: 0.2346
+- Accuracy: 0.9369
+- F1: 0.9340
+- Precision: 0.9471
+- Recall: 0.9369
 
 ## Model description
 
@@ -50,22 +51,15 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 64
-- num_epochs: 10
+- num_epochs: 3
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
-| 2.3662        | 1.0   | 65   | 2.3486          | 0.0901   | 0.0149 | 0.0081    | 0.0901 |
-| 2.3449        | 2.0   | 130  | 2.2698          | 0.1982   | 0.1149 | 0.0942    | 0.1982 |
-| 2.2956        | 3.0   | 195  | 2.2133          | 0.1396   | 0.0764 | 0.0628    | 0.1396 |
-| 2.2669        | 4.0   | 260  | 2.1724          | 0.1712   | 0.1367 | 0.1656    | 0.1712 |
-| 2.2199        | 5.0   | 325  | 2.2163          | 0.1577   | 0.1191 | 0.1388    | 0.1577 |
-| 2.2279        | 6.0   | 390  | 2.1963          | 0.1396   | 0.1008 | 0.1460    | 0.1396 |
-| 2.1828        | 7.0   | 455  | 2.1606          | 0.1892   | 0.1644 | 0.2060    | 0.1892 |
-| 2.1635        | 8.0   | 520  | 2.1509          | 0.1982   | 0.1701 | 0.2170    | 0.1982 |
-| 2.1588        | 9.0   | 585  | 2.1404          | 0.1937   | 0.1677 | 0.2157    | 0.1937 |
-| 2.1415        | 10.0  | 650  | 2.1212          | 0.2027   | 0.1743 | 0.2244    | 0.2027 |
+| 1.9427        | 1.0   | 65   | 0.7129          | 0.8964   | 0.8947 | 0.9055    | 0.8964 |
+| 0.48          | 2.0   | 130  | 0.2325          | 0.9369   | 0.9365 | 0.9390    | 0.9369 |
+| 0.1783        | 3.0   | 195  | 0.2001          | 0.9505   | 0.9511 | 0.9578    | 0.9505 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f935aa99744adff8445334028824b31fb25afc57120204bbdbfc6937ae62ddfb
+oid sha256:17f0dbab94301771a00a8c01f542bdfd97d3aa0d6a562737a6e6a55a3b7d0fa8
 size 421031944

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3c7e2c9ca05318848c0a86ee350cda4342d1f874e9a7302018d754b547b812e9
+oid sha256:42af8a8756d11ce89a4786bb5f9dfc1bad723178eddd82d10364980da825ec1a
 size 5240