ctaguchi commited on
Commit
684dd5d
·
verified ·
1 Parent(s): 280c00c

Model save

Browse files
Files changed (2) hide show
  1. README.md +85 -0
  2. model.safetensors +1 -1
README.md ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: facebook/hubert-large-ll60k
5
+ tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: hubert-large-ll60k-gui-ufe
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # hubert-large-ll60k-gui-ufe
16
+
17
+ This model is a fine-tuned version of [facebook/hubert-large-ll60k](https://huggingface.co/facebook/hubert-large-ll60k) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 3.0332
20
+ - Cer: 1.0
21
+
22
+ ## Model description
23
+
24
+ More information needed
25
+
26
+ ## Intended uses & limitations
27
+
28
+ More information needed
29
+
30
+ ## Training and evaluation data
31
+
32
+ More information needed
33
+
34
+ ## Training procedure
35
+
36
+ ### Training hyperparameters
37
+
38
+ The following hyperparameters were used during training:
39
+ - learning_rate: 0.0003
40
+ - train_batch_size: 8
41
+ - eval_batch_size: 8
42
+ - seed: 42
43
+ - gradient_accumulation_steps: 2
44
+ - total_train_batch_size: 16
45
+ - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
+ - lr_scheduler_type: linear
47
+ - lr_scheduler_warmup_steps: 100
48
+ - num_epochs: 10
49
+ - mixed_precision_training: Native AMP
50
+
51
+ ### Training results
52
+
53
+ | Training Loss | Epoch | Step | Validation Loss | Cer |
54
+ |:-------------:|:------:|:----:|:---------------:|:---:|
55
+ | 12.7179 | 0.4329 | 100 | 2.9635 | 1.0 |
56
+ | 5.9177 | 0.8658 | 200 | 2.9109 | 1.0 |
57
+ | 5.9451 | 1.2987 | 300 | 2.9614 | 1.0 |
58
+ | 5.9373 | 1.7316 | 400 | 2.9688 | 1.0 |
59
+ | 6.0992 | 2.1645 | 500 | 2.9031 | 1.0 |
60
+ | 5.8871 | 2.5974 | 600 | 2.8871 | 1.0 |
61
+ | 5.9773 | 3.0303 | 700 | 2.9620 | 1.0 |
62
+ | 6.0069 | 3.4632 | 800 | 2.9517 | 1.0 |
63
+ | 5.9892 | 3.8961 | 900 | 2.9592 | 1.0 |
64
+ | 5.9731 | 4.3290 | 1000 | 2.9473 | 1.0 |
65
+ | 5.9879 | 4.7619 | 1100 | 2.9479 | 1.0 |
66
+ | 6.0309 | 5.1948 | 1200 | 2.9910 | 1.0 |
67
+ | 5.9473 | 5.6277 | 1300 | 2.9572 | 1.0 |
68
+ | 6.0225 | 6.0606 | 1400 | 2.9512 | 1.0 |
69
+ | 6.0506 | 6.4935 | 1500 | 2.9782 | 1.0 |
70
+ | 6.0465 | 6.9264 | 1600 | 2.9807 | 1.0 |
71
+ | 6.0775 | 7.3593 | 1700 | 2.9781 | 1.0 |
72
+ | 6.0678 | 7.7922 | 1800 | 2.9842 | 1.0 |
73
+ | 6.0392 | 8.2251 | 1900 | 2.9986 | 1.0 |
74
+ | 6.1305 | 8.6580 | 2000 | 3.0216 | 1.0 |
75
+ | 6.1608 | 9.0909 | 2100 | 3.0306 | 1.0 |
76
+ | 6.1697 | 9.5238 | 2200 | 3.0266 | 1.0 |
77
+ | 6.1319 | 9.9567 | 2300 | 3.0332 | 1.0 |
78
+
79
+
80
+ ### Framework versions
81
+
82
+ - Transformers 5.1.0
83
+ - Pytorch 2.9.1+cu128
84
+ - Datasets 3.6.0
85
+ - Tokenizers 0.22.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:281e817ed10bf10dd4c7c615dd942f7bdb3354f9b4d948f8f8fa0eae3c403396
3
  size 1261966500
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67719ce4e4efdbdd7036e0627f79f9cdc42ce6f06ffad9fa587395fac922c52f
3
  size 1261966500