camembertav2-base-name-classifier-v2
Browse files
README.md
CHANGED
|
@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 21 |
|
| 22 |
This model is a fine-tuned version of [almanach/camembertav2-base](https://huggingface.co/almanach/camembertav2-base) on an unknown dataset.
|
| 23 |
It achieves the following results on the evaluation set:
|
| 24 |
-
- Loss: 0.
|
| 25 |
-
- Accuracy: 0.
|
| 26 |
-
- Precision: 0.
|
| 27 |
-
- Recall: 0.
|
| 28 |
-
- F1: 0.
|
| 29 |
|
| 30 |
## Model description
|
| 31 |
|
|
@@ -50,25 +50,31 @@ The following hyperparameters were used during training:
|
|
| 50 |
- seed: 42
|
| 51 |
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 52 |
- lr_scheduler_type: linear
|
| 53 |
-
- lr_scheduler_warmup_steps:
|
| 54 |
-
- num_epochs: 1
|
| 55 |
|
| 56 |
### Training results
|
| 57 |
|
| 58 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
|
| 59 |
|:-------------:|:------:|:-----:|:---------------:|:--------:|:---------:|:------:|:------:|
|
| 60 |
-
| 0.
|
| 61 |
-
| 0.
|
| 62 |
-
| 0.
|
| 63 |
-
| 0.
|
| 64 |
-
| 0.
|
| 65 |
-
| 0.
|
| 66 |
-
| 0.
|
| 67 |
-
| 0.
|
| 68 |
-
| 0.
|
| 69 |
-
| 0.
|
| 70 |
-
| 0.
|
| 71 |
-
| 0.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
|
| 73 |
|
| 74 |
### Framework versions
|
|
|
|
| 21 |
|
| 22 |
This model is a fine-tuned version of [almanach/camembertav2-base](https://huggingface.co/almanach/camembertav2-base) on an unknown dataset.
|
| 23 |
It achieves the following results on the evaluation set:
|
| 24 |
+
- Loss: 0.0331
|
| 25 |
+
- Accuracy: 0.9912
|
| 26 |
+
- Precision: 0.9971
|
| 27 |
+
- Recall: 0.9872
|
| 28 |
+
- F1: 0.9922
|
| 29 |
|
| 30 |
## Model description
|
| 31 |
|
|
|
|
| 50 |
- seed: 42
|
| 51 |
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 52 |
- lr_scheduler_type: linear
|
| 53 |
+
- lr_scheduler_warmup_steps: 1000
|
| 54 |
+
- num_epochs: 1.5
|
| 55 |
|
| 56 |
### Training results
|
| 57 |
|
| 58 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
|
| 59 |
|:-------------:|:------:|:-----:|:---------------:|:--------:|:---------:|:------:|:------:|
|
| 60 |
+
| 0.0416 | 0.0826 | 2000 | 0.0355 | 0.9902 | 0.9949 | 0.9876 | 0.9913 |
|
| 61 |
+
| 0.0325 | 0.1652 | 4000 | 0.0330 | 0.9910 | 0.9942 | 0.9898 | 0.9920 |
|
| 62 |
+
| 0.0335 | 0.2479 | 6000 | 0.0314 | 0.9914 | 0.9950 | 0.9896 | 0.9923 |
|
| 63 |
+
| 0.0342 | 0.3305 | 8000 | 0.0313 | 0.9916 | 0.9948 | 0.9902 | 0.9925 |
|
| 64 |
+
| 0.0305 | 0.4131 | 10000 | 0.0331 | 0.9912 | 0.9971 | 0.9873 | 0.9922 |
|
| 65 |
+
| 0.0305 | 0.4957 | 12000 | 0.0298 | 0.9920 | 0.9958 | 0.9898 | 0.9928 |
|
| 66 |
+
| 0.0302 | 0.5783 | 14000 | 0.0294 | 0.9919 | 0.9948 | 0.9907 | 0.9928 |
|
| 67 |
+
| 0.0309 | 0.6609 | 16000 | 0.0286 | 0.9920 | 0.9964 | 0.9895 | 0.9929 |
|
| 68 |
+
| 0.0287 | 0.7436 | 18000 | 0.0293 | 0.9918 | 0.9939 | 0.9916 | 0.9928 |
|
| 69 |
+
| 0.0284 | 0.8262 | 20000 | 0.0288 | 0.9922 | 0.9954 | 0.9907 | 0.9931 |
|
| 70 |
+
| 0.0274 | 0.9088 | 22000 | 0.0287 | 0.9924 | 0.9962 | 0.9902 | 0.9932 |
|
| 71 |
+
| 0.0293 | 0.9914 | 24000 | 0.0281 | 0.9925 | 0.9960 | 0.9906 | 0.9933 |
|
| 72 |
+
| 0.025 | 1.0740 | 26000 | 0.0285 | 0.9923 | 0.9955 | 0.9909 | 0.9932 |
|
| 73 |
+
| 0.0233 | 1.1566 | 28000 | 0.0292 | 0.9924 | 0.9954 | 0.9911 | 0.9932 |
|
| 74 |
+
| 0.024 | 1.2393 | 30000 | 0.0283 | 0.9924 | 0.9950 | 0.9914 | 0.9932 |
|
| 75 |
+
| 0.0286 | 1.3219 | 32000 | 0.0275 | 0.9925 | 0.9961 | 0.9905 | 0.9933 |
|
| 76 |
+
| 0.0249 | 1.4045 | 34000 | 0.0277 | 0.9925 | 0.9958 | 0.9908 | 0.9933 |
|
| 77 |
+
| 0.0246 | 1.4871 | 36000 | 0.0278 | 0.9925 | 0.9956 | 0.9910 | 0.9933 |
|
| 78 |
|
| 79 |
|
| 80 |
### Framework versions
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 444859368
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:819b07d35e93e321d11d555e2d77b0d710d9204013a3a0179b62e23abe00a600
|
| 3 |
size 444859368
|
runs/Nov26_22-24-41_elesage-pc/events.out.tfevents.1764213980.elesage-pc.93364.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f0744b669a2cc991dada5867b9904af05909cc5591c3c361c7e4bc511aef12a3
|
| 3 |
+
size 53065
|
runs/Nov26_22-24-41_elesage-pc/events.out.tfevents.1764216758.elesage-pc.93364.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:300a9ddf0a4c505db9403d8f8bb42a9ac9d006d3e4f3938d0007d22a7a951de6
|
| 3 |
+
size 569
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5905
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7e04c1ca5bd29e8db7f77c0d409bae611beb9b68bce5aa05b5e5e44c5a96d8a3
|
| 3 |
size 5905
|