End of training
Browse files- README.md +132 -195
- adapter.mmc.safetensors +3 -0
- config.json +107 -0
- model.safetensors +3 -0
- preprocessor_config.json +9 -0
- training_args.bin +3 -0
- vocab.json +1 -167
README.md
CHANGED
|
@@ -1,199 +1,136 @@
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
---
|
| 5 |
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
###
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
| 81 |
-
|
| 82 |
-
|
| 83 |
-
|
| 84 |
-
|
| 85 |
-
|
| 86 |
-
|
| 87 |
-
|
| 88 |
-
|
| 89 |
-
|
| 90 |
-
|
| 91 |
-
|
| 92 |
-
|
| 93 |
-
|
| 94 |
-
|
| 95 |
-
|
| 96 |
-
|
| 97 |
-
|
| 98 |
-
|
| 99 |
-
|
| 100 |
-
|
| 101 |
-
|
| 102 |
-
|
| 103 |
-
|
| 104 |
-
|
| 105 |
-
|
| 106 |
-
|
| 107 |
-
|
| 108 |
-
|
| 109 |
-
|
| 110 |
-
|
| 111 |
-
|
| 112 |
-
|
| 113 |
-
|
| 114 |
-
|
| 115 |
-
|
| 116 |
-
|
| 117 |
-
|
| 118 |
-
|
| 119 |
-
|
| 120 |
-
|
| 121 |
-
|
| 122 |
-
|
| 123 |
-
|
| 124 |
-
|
| 125 |
-
|
| 126 |
-
|
| 127 |
-
|
| 128 |
-
|
| 129 |
-
[More Information Needed]
|
| 130 |
-
|
| 131 |
-
#### Summary
|
| 132 |
-
|
| 133 |
-
|
| 134 |
-
|
| 135 |
-
## Model Examination [optional]
|
| 136 |
-
|
| 137 |
-
<!-- Relevant interpretability work for the model goes here -->
|
| 138 |
-
|
| 139 |
-
[More Information Needed]
|
| 140 |
-
|
| 141 |
-
## Environmental Impact
|
| 142 |
-
|
| 143 |
-
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
| 144 |
-
|
| 145 |
-
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
| 146 |
-
|
| 147 |
-
- **Hardware Type:** [More Information Needed]
|
| 148 |
-
- **Hours used:** [More Information Needed]
|
| 149 |
-
- **Cloud Provider:** [More Information Needed]
|
| 150 |
-
- **Compute Region:** [More Information Needed]
|
| 151 |
-
- **Carbon Emitted:** [More Information Needed]
|
| 152 |
-
|
| 153 |
-
## Technical Specifications [optional]
|
| 154 |
-
|
| 155 |
-
### Model Architecture and Objective
|
| 156 |
-
|
| 157 |
-
[More Information Needed]
|
| 158 |
-
|
| 159 |
-
### Compute Infrastructure
|
| 160 |
-
|
| 161 |
-
[More Information Needed]
|
| 162 |
-
|
| 163 |
-
#### Hardware
|
| 164 |
-
|
| 165 |
-
[More Information Needed]
|
| 166 |
-
|
| 167 |
-
#### Software
|
| 168 |
-
|
| 169 |
-
[More Information Needed]
|
| 170 |
-
|
| 171 |
-
## Citation [optional]
|
| 172 |
-
|
| 173 |
-
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
| 174 |
-
|
| 175 |
-
**BibTeX:**
|
| 176 |
-
|
| 177 |
-
[More Information Needed]
|
| 178 |
-
|
| 179 |
-
**APA:**
|
| 180 |
-
|
| 181 |
-
[More Information Needed]
|
| 182 |
-
|
| 183 |
-
## Glossary [optional]
|
| 184 |
-
|
| 185 |
-
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
|
| 186 |
-
|
| 187 |
-
[More Information Needed]
|
| 188 |
-
|
| 189 |
-
## More Information [optional]
|
| 190 |
-
|
| 191 |
-
[More Information Needed]
|
| 192 |
-
|
| 193 |
-
## Model Card Authors [optional]
|
| 194 |
-
|
| 195 |
-
[More Information Needed]
|
| 196 |
-
|
| 197 |
-
## Model Card Contact
|
| 198 |
-
|
| 199 |
-
[More Information Needed]
|
|
|
|
| 1 |
---
|
| 2 |
library_name: transformers
|
| 3 |
+
license: cc-by-nc-4.0
|
| 4 |
+
base_model: facebook/mms-1b-all
|
| 5 |
+
tags:
|
| 6 |
+
- generated_from_trainer
|
| 7 |
+
metrics:
|
| 8 |
+
- wer
|
| 9 |
+
model-index:
|
| 10 |
+
- name: ssc-mmc-mms-model-mix-adapt-max3-devtrain
|
| 11 |
+
results: []
|
| 12 |
---
|
| 13 |
|
| 14 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 15 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 16 |
+
|
| 17 |
+
# ssc-mmc-mms-model-mix-adapt-max3-devtrain
|
| 18 |
+
|
| 19 |
+
This model is a fine-tuned version of [facebook/mms-1b-all](https://huggingface.co/facebook/mms-1b-all) on an unknown dataset.
|
| 20 |
+
It achieves the following results on the evaluation set:
|
| 21 |
+
- Loss: 0.8857
|
| 22 |
+
- Cer: 0.2393
|
| 23 |
+
- Wer: 0.5815
|
| 24 |
+
|
| 25 |
+
## Model description
|
| 26 |
+
|
| 27 |
+
More information needed
|
| 28 |
+
|
| 29 |
+
## Intended uses & limitations
|
| 30 |
+
|
| 31 |
+
More information needed
|
| 32 |
+
|
| 33 |
+
## Training and evaluation data
|
| 34 |
+
|
| 35 |
+
More information needed
|
| 36 |
+
|
| 37 |
+
## Training procedure
|
| 38 |
+
|
| 39 |
+
### Training hyperparameters
|
| 40 |
+
|
| 41 |
+
The following hyperparameters were used during training:
|
| 42 |
+
- learning_rate: 0.0005
|
| 43 |
+
- train_batch_size: 8
|
| 44 |
+
- eval_batch_size: 6
|
| 45 |
+
- seed: 42
|
| 46 |
+
- gradient_accumulation_steps: 2
|
| 47 |
+
- total_train_batch_size: 16
|
| 48 |
+
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 49 |
+
- lr_scheduler_type: linear
|
| 50 |
+
- lr_scheduler_warmup_steps: 100
|
| 51 |
+
- num_epochs: 20
|
| 52 |
+
- mixed_precision_training: Native AMP
|
| 53 |
+
|
| 54 |
+
### Training results
|
| 55 |
+
|
| 56 |
+
| Training Loss | Epoch | Step | Validation Loss | Cer | Wer |
|
| 57 |
+
|:-------------:|:-------:|:-----:|:---------------:|:------:|:------:|
|
| 58 |
+
| 2.037 | 0.2803 | 200 | 1.4866 | 0.3482 | 0.7704 |
|
| 59 |
+
| 1.6013 | 0.5606 | 400 | 1.2655 | 0.3096 | 0.7048 |
|
| 60 |
+
| 1.4971 | 0.8409 | 600 | 1.1954 | 0.3003 | 0.6941 |
|
| 61 |
+
| 1.4418 | 1.1205 | 800 | 1.1713 | 0.2920 | 0.6872 |
|
| 62 |
+
| 1.4512 | 1.4008 | 1000 | 1.1212 | 0.2852 | 0.6568 |
|
| 63 |
+
| 1.4548 | 1.6811 | 1200 | 1.1313 | 0.2909 | 0.6727 |
|
| 64 |
+
| 1.4091 | 1.9615 | 1400 | 1.0973 | 0.2803 | 0.6512 |
|
| 65 |
+
| 1.3783 | 2.2411 | 1600 | 1.0624 | 0.2735 | 0.6373 |
|
| 66 |
+
| 1.3352 | 2.5214 | 1800 | 1.0520 | 0.2734 | 0.6506 |
|
| 67 |
+
| 1.3385 | 2.8017 | 2000 | 1.0440 | 0.2696 | 0.6354 |
|
| 68 |
+
| 1.3509 | 3.0813 | 2200 | 1.0346 | 0.2699 | 0.6357 |
|
| 69 |
+
| 1.3288 | 3.3616 | 2400 | 1.0316 | 0.2679 | 0.6272 |
|
| 70 |
+
| 1.3297 | 3.6419 | 2600 | 1.0292 | 0.2717 | 0.6406 |
|
| 71 |
+
| 1.3295 | 3.9222 | 2800 | 1.0210 | 0.2661 | 0.6227 |
|
| 72 |
+
| 1.2545 | 4.2018 | 3000 | 1.0265 | 0.2675 | 0.6220 |
|
| 73 |
+
| 1.2892 | 4.4821 | 3200 | 1.0432 | 0.2682 | 0.6307 |
|
| 74 |
+
| 1.2743 | 4.7624 | 3400 | 1.0247 | 0.2696 | 0.6328 |
|
| 75 |
+
| 1.2602 | 5.0420 | 3600 | 1.0064 | 0.2612 | 0.6320 |
|
| 76 |
+
| 1.2304 | 5.3224 | 3800 | 0.9983 | 0.2605 | 0.6137 |
|
| 77 |
+
| 1.2485 | 5.6027 | 4000 | 0.9865 | 0.2606 | 0.6153 |
|
| 78 |
+
| 1.2809 | 5.8830 | 4200 | 1.0008 | 0.2621 | 0.6244 |
|
| 79 |
+
| 1.2645 | 6.1626 | 4400 | 0.9878 | 0.2617 | 0.6184 |
|
| 80 |
+
| 1.2498 | 6.4429 | 4600 | 0.9697 | 0.2592 | 0.6088 |
|
| 81 |
+
| 1.2493 | 6.7232 | 4800 | 0.9764 | 0.2579 | 0.6072 |
|
| 82 |
+
| 1.2766 | 7.0028 | 5000 | 0.9755 | 0.2598 | 0.6127 |
|
| 83 |
+
| 1.2008 | 7.2831 | 5200 | 0.9856 | 0.2600 | 0.6158 |
|
| 84 |
+
| 1.2236 | 7.5634 | 5400 | 0.9799 | 0.2589 | 0.6113 |
|
| 85 |
+
| 1.2314 | 7.8437 | 5600 | 0.9697 | 0.2608 | 0.6214 |
|
| 86 |
+
| 1.1737 | 8.1233 | 5800 | 0.9668 | 0.2552 | 0.6048 |
|
| 87 |
+
| 1.226 | 8.4036 | 6000 | 0.9939 | 0.2596 | 0.6263 |
|
| 88 |
+
| 1.1786 | 8.6840 | 6200 | 0.9626 | 0.2548 | 0.6069 |
|
| 89 |
+
| 1.1727 | 8.9643 | 6400 | 0.9721 | 0.2546 | 0.6029 |
|
| 90 |
+
| 1.1681 | 9.2439 | 6600 | 0.9593 | 0.2541 | 0.6023 |
|
| 91 |
+
| 1.1573 | 9.5242 | 6800 | 0.9428 | 0.2518 | 0.6100 |
|
| 92 |
+
| 1.1613 | 9.8045 | 7000 | 0.9520 | 0.2544 | 0.5994 |
|
| 93 |
+
| 1.1747 | 10.0841 | 7200 | 0.9409 | 0.2514 | 0.5986 |
|
| 94 |
+
| 1.1799 | 10.3644 | 7400 | 0.9372 | 0.2483 | 0.5955 |
|
| 95 |
+
| 1.1322 | 10.6447 | 7600 | 0.9432 | 0.2505 | 0.5958 |
|
| 96 |
+
| 1.1394 | 10.9250 | 7800 | 0.9521 | 0.2520 | 0.6004 |
|
| 97 |
+
| 1.1284 | 11.2046 | 8000 | 0.9400 | 0.2508 | 0.5919 |
|
| 98 |
+
| 1.1209 | 11.4849 | 8200 | 0.9439 | 0.2518 | 0.6017 |
|
| 99 |
+
| 1.1309 | 11.7652 | 8400 | 0.9448 | 0.2488 | 0.5949 |
|
| 100 |
+
| 1.0763 | 12.0448 | 8600 | 0.9377 | 0.2459 | 0.5935 |
|
| 101 |
+
| 1.1177 | 12.3252 | 8800 | 0.9414 | 0.2480 | 0.5933 |
|
| 102 |
+
| 1.0991 | 12.6055 | 9000 | 0.9406 | 0.2481 | 0.5961 |
|
| 103 |
+
| 1.1344 | 12.8858 | 9200 | 0.9333 | 0.2466 | 0.5977 |
|
| 104 |
+
| 1.0788 | 13.1654 | 9400 | 0.9256 | 0.2469 | 0.5916 |
|
| 105 |
+
| 1.0727 | 13.4457 | 9600 | 0.9087 | 0.2447 | 0.5916 |
|
| 106 |
+
| 1.0711 | 13.7260 | 9800 | 0.9107 | 0.2434 | 0.5881 |
|
| 107 |
+
| 1.1605 | 14.0056 | 10000 | 0.9138 | 0.2448 | 0.5886 |
|
| 108 |
+
| 1.1109 | 14.2859 | 10200 | 0.9238 | 0.2444 | 0.5929 |
|
| 109 |
+
| 1.0427 | 14.5662 | 10400 | 0.9053 | 0.2423 | 0.5841 |
|
| 110 |
+
| 1.0677 | 14.8465 | 10600 | 0.9126 | 0.2425 | 0.5873 |
|
| 111 |
+
| 1.0662 | 15.1261 | 10800 | 0.9079 | 0.2429 | 0.5899 |
|
| 112 |
+
| 1.0476 | 15.4064 | 11000 | 0.9074 | 0.2424 | 0.5866 |
|
| 113 |
+
| 1.0644 | 15.6868 | 11200 | 0.9087 | 0.2431 | 0.5857 |
|
| 114 |
+
| 1.0739 | 15.9671 | 11400 | 0.9019 | 0.2427 | 0.5902 |
|
| 115 |
+
| 1.0621 | 16.2467 | 11600 | 0.8995 | 0.2414 | 0.5868 |
|
| 116 |
+
| 1.0654 | 16.5270 | 11800 | 0.9013 | 0.2407 | 0.5847 |
|
| 117 |
+
| 1.0352 | 16.8073 | 12000 | 0.8967 | 0.2410 | 0.5850 |
|
| 118 |
+
| 1.0703 | 17.0869 | 12200 | 0.8984 | 0.2405 | 0.5845 |
|
| 119 |
+
| 1.0605 | 17.3672 | 12400 | 0.8973 | 0.2414 | 0.5858 |
|
| 120 |
+
| 1.0434 | 17.6475 | 12600 | 0.8939 | 0.2405 | 0.5818 |
|
| 121 |
+
| 1.0416 | 17.9278 | 12800 | 0.8897 | 0.2401 | 0.5829 |
|
| 122 |
+
| 1.038 | 18.2074 | 13000 | 0.8937 | 0.2389 | 0.5818 |
|
| 123 |
+
| 1.0558 | 18.4877 | 13200 | 0.8930 | 0.2389 | 0.5822 |
|
| 124 |
+
| 1.026 | 18.7680 | 13400 | 0.8899 | 0.2394 | 0.5813 |
|
| 125 |
+
| 0.9742 | 19.0477 | 13600 | 0.8825 | 0.2380 | 0.5795 |
|
| 126 |
+
| 1.0177 | 19.3280 | 13800 | 0.8843 | 0.2386 | 0.5786 |
|
| 127 |
+
| 0.9995 | 19.6083 | 14000 | 0.8864 | 0.2392 | 0.5816 |
|
| 128 |
+
| 1.002 | 19.8886 | 14200 | 0.8857 | 0.2393 | 0.5815 |
|
| 129 |
+
|
| 130 |
+
|
| 131 |
+
### Framework versions
|
| 132 |
+
|
| 133 |
+
- Transformers 4.52.1
|
| 134 |
+
- Pytorch 2.9.1+cu128
|
| 135 |
+
- Datasets 3.6.0
|
| 136 |
+
- Tokenizers 0.21.4
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
adapter.mmc.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:750387844ad8d76ea837208d361b8df01a870d935f89c3173e9e796da2adf3a2
|
| 3 |
+
size 9485204
|
config.json
ADDED
|
@@ -0,0 +1,107 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"activation_dropout": 0.05,
|
| 3 |
+
"adapter_attn_dim": 16,
|
| 4 |
+
"adapter_kernel_size": 3,
|
| 5 |
+
"adapter_stride": 2,
|
| 6 |
+
"add_adapter": false,
|
| 7 |
+
"apply_spec_augment": true,
|
| 8 |
+
"architectures": [
|
| 9 |
+
"Wav2Vec2ForCTC"
|
| 10 |
+
],
|
| 11 |
+
"attention_dropout": 0.0,
|
| 12 |
+
"bos_token_id": 1,
|
| 13 |
+
"classifier_proj_size": 256,
|
| 14 |
+
"codevector_dim": 1024,
|
| 15 |
+
"contrastive_logits_temperature": 0.1,
|
| 16 |
+
"conv_bias": true,
|
| 17 |
+
"conv_dim": [
|
| 18 |
+
512,
|
| 19 |
+
512,
|
| 20 |
+
512,
|
| 21 |
+
512,
|
| 22 |
+
512,
|
| 23 |
+
512,
|
| 24 |
+
512
|
| 25 |
+
],
|
| 26 |
+
"conv_kernel": [
|
| 27 |
+
10,
|
| 28 |
+
3,
|
| 29 |
+
3,
|
| 30 |
+
3,
|
| 31 |
+
3,
|
| 32 |
+
2,
|
| 33 |
+
2
|
| 34 |
+
],
|
| 35 |
+
"conv_stride": [
|
| 36 |
+
5,
|
| 37 |
+
2,
|
| 38 |
+
2,
|
| 39 |
+
2,
|
| 40 |
+
2,
|
| 41 |
+
2,
|
| 42 |
+
2
|
| 43 |
+
],
|
| 44 |
+
"ctc_loss_reduction": "mean",
|
| 45 |
+
"ctc_zero_infinity": false,
|
| 46 |
+
"diversity_loss_weight": 0.1,
|
| 47 |
+
"do_stable_layer_norm": true,
|
| 48 |
+
"eos_token_id": 2,
|
| 49 |
+
"feat_extract_activation": "gelu",
|
| 50 |
+
"feat_extract_dropout": 0.0,
|
| 51 |
+
"feat_extract_norm": "layer",
|
| 52 |
+
"feat_proj_dropout": 0.0,
|
| 53 |
+
"feat_quantizer_dropout": 0.0,
|
| 54 |
+
"final_dropout": 0.05,
|
| 55 |
+
"hidden_act": "gelu",
|
| 56 |
+
"hidden_dropout": 0.0,
|
| 57 |
+
"hidden_size": 1280,
|
| 58 |
+
"initializer_range": 0.02,
|
| 59 |
+
"intermediate_size": 5120,
|
| 60 |
+
"layer_norm_eps": 1e-05,
|
| 61 |
+
"layerdrop": 0.0,
|
| 62 |
+
"mask_feature_length": 10,
|
| 63 |
+
"mask_feature_min_masks": 0,
|
| 64 |
+
"mask_feature_prob": 0.0,
|
| 65 |
+
"mask_time_length": 10,
|
| 66 |
+
"mask_time_min_masks": 2,
|
| 67 |
+
"mask_time_prob": 0.05,
|
| 68 |
+
"model_type": "wav2vec2",
|
| 69 |
+
"num_adapter_layers": 3,
|
| 70 |
+
"num_attention_heads": 16,
|
| 71 |
+
"num_codevector_groups": 2,
|
| 72 |
+
"num_codevectors_per_group": 320,
|
| 73 |
+
"num_conv_pos_embedding_groups": 16,
|
| 74 |
+
"num_conv_pos_embeddings": 128,
|
| 75 |
+
"num_feat_extract_layers": 7,
|
| 76 |
+
"num_hidden_layers": 48,
|
| 77 |
+
"num_negatives": 100,
|
| 78 |
+
"output_hidden_size": 1280,
|
| 79 |
+
"pad_token_id": 162,
|
| 80 |
+
"proj_codevector_dim": 1024,
|
| 81 |
+
"tdnn_dilation": [
|
| 82 |
+
1,
|
| 83 |
+
2,
|
| 84 |
+
3,
|
| 85 |
+
1,
|
| 86 |
+
1
|
| 87 |
+
],
|
| 88 |
+
"tdnn_dim": [
|
| 89 |
+
512,
|
| 90 |
+
512,
|
| 91 |
+
512,
|
| 92 |
+
512,
|
| 93 |
+
1500
|
| 94 |
+
],
|
| 95 |
+
"tdnn_kernel": [
|
| 96 |
+
5,
|
| 97 |
+
3,
|
| 98 |
+
3,
|
| 99 |
+
1,
|
| 100 |
+
1
|
| 101 |
+
],
|
| 102 |
+
"torch_dtype": "float32",
|
| 103 |
+
"transformers_version": "4.52.1",
|
| 104 |
+
"use_weighted_layer_sum": false,
|
| 105 |
+
"vocab_size": 165,
|
| 106 |
+
"xvector_output_dim": 512
|
| 107 |
+
}
|
model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f850e7b1dea22a3361a35e93e04be94e853c3a06c98887f6e335548beb68c2f6
|
| 3 |
+
size 3859577548
|
preprocessor_config.json
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"do_normalize": true,
|
| 3 |
+
"feature_extractor_type": "Wav2Vec2FeatureExtractor",
|
| 4 |
+
"feature_size": 1,
|
| 5 |
+
"padding_side": "right",
|
| 6 |
+
"padding_value": 0.0,
|
| 7 |
+
"return_attention_mask": true,
|
| 8 |
+
"sampling_rate": 16000
|
| 9 |
+
}
|
training_args.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a79f7d930fc883ad273a019b8d5b9b283ddd6d1595c6f1f9c8e0ef9c1e6cdb8f
|
| 3 |
+
size 5969
|
vocab.json
CHANGED
|
@@ -1,167 +1 @@
|
|
| 1 |
-
{
|
| 2 |
-
"mmc": {
|
| 3 |
-
"'": 71,
|
| 4 |
-
"'w": 133,
|
| 5 |
-
".": 114,
|
| 6 |
-
"...": 160,
|
| 7 |
-
"A": 103,
|
| 8 |
-
"B": 147,
|
| 9 |
-
"C": 10,
|
| 10 |
-
"D": 75,
|
| 11 |
-
"E": 84,
|
| 12 |
-
"G": 36,
|
| 13 |
-
"H": 91,
|
| 14 |
-
"I": 111,
|
| 15 |
-
"J": 30,
|
| 16 |
-
"K": 59,
|
| 17 |
-
"L": 121,
|
| 18 |
-
"M": 6,
|
| 19 |
-
"N": 28,
|
| 20 |
-
"O": 118,
|
| 21 |
-
"P": 125,
|
| 22 |
-
"R": 158,
|
| 23 |
-
"S": 8,
|
| 24 |
-
"T": 113,
|
| 25 |
-
"V": 15,
|
| 26 |
-
"X": 148,
|
| 27 |
-
"Y": 119,
|
| 28 |
-
"Z": 106,
|
| 29 |
-
"[PAD]": 162,
|
| 30 |
-
"[UNK]": 161,
|
| 31 |
-
"a": 151,
|
| 32 |
-
"ā": 141,
|
| 33 |
-
"ā̀": 102,
|
| 34 |
-
"ā́": 21,
|
| 35 |
-
"ā̂": 58,
|
| 36 |
-
"ā̌": 77,
|
| 37 |
-
"b": 43,
|
| 38 |
-
"c": 131,
|
| 39 |
-
"ch": 145,
|
| 40 |
-
"ch'": 136,
|
| 41 |
-
"chj": 33,
|
| 42 |
-
"d": 14,
|
| 43 |
-
"dy": 34,
|
| 44 |
-
"e": 142,
|
| 45 |
-
"ē": 57,
|
| 46 |
-
"ḗ": 18,
|
| 47 |
-
"f": 107,
|
| 48 |
-
"g": 76,
|
| 49 |
-
"h": 80,
|
| 50 |
-
"i": 20,
|
| 51 |
-
"ī": 70,
|
| 52 |
-
"ī̀": 81,
|
| 53 |
-
"ī́": 156,
|
| 54 |
-
"ī̂": 65,
|
| 55 |
-
"ī̌": 25,
|
| 56 |
-
"j": 124,
|
| 57 |
-
"j'": 86,
|
| 58 |
-
"jm": 127,
|
| 59 |
-
"jn": 44,
|
| 60 |
-
"jw": 69,
|
| 61 |
-
"jy": 3,
|
| 62 |
-
"jñ": 95,
|
| 63 |
-
"k": 109,
|
| 64 |
-
"k'": 135,
|
| 65 |
-
"kj": 82,
|
| 66 |
-
"l": 32,
|
| 67 |
-
"m": 60,
|
| 68 |
-
"m'": 129,
|
| 69 |
-
"n": 90,
|
| 70 |
-
"n'": 4,
|
| 71 |
-
"ndz": 23,
|
| 72 |
-
"ndzh": 42,
|
| 73 |
-
"o": 101,
|
| 74 |
-
"ō": 92,
|
| 75 |
-
"ṑ": 126,
|
| 76 |
-
"ṓ": 116,
|
| 77 |
-
"ō̂": 66,
|
| 78 |
-
"ō̌": 41,
|
| 79 |
-
"p": 5,
|
| 80 |
-
"pj": 61,
|
| 81 |
-
"q": 11,
|
| 82 |
-
"r": 72,
|
| 83 |
-
"s": 152,
|
| 84 |
-
"s'": 2,
|
| 85 |
-
"sj": 13,
|
| 86 |
-
"t": 100,
|
| 87 |
-
"t'": 0,
|
| 88 |
-
"tj": 49,
|
| 89 |
-
"ts'": 130,
|
| 90 |
-
"tsj": 35,
|
| 91 |
-
"u": 19,
|
| 92 |
-
"ū": 115,
|
| 93 |
-
"ū̀": 38,
|
| 94 |
-
"ū́": 31,
|
| 95 |
-
"ū̂": 93,
|
| 96 |
-
"ū̌": 73,
|
| 97 |
-
"v": 50,
|
| 98 |
-
"w": 1,
|
| 99 |
-
"x": 39,
|
| 100 |
-
"y": 85,
|
| 101 |
-
"z": 157,
|
| 102 |
-
"zh": 29,
|
| 103 |
-
"|": 27,
|
| 104 |
-
"´": 74,
|
| 105 |
-
"À": 12,
|
| 106 |
-
"Ì": 137,
|
| 107 |
-
"Í": 154,
|
| 108 |
-
"Ñ": 120,
|
| 109 |
-
"Ó": 78,
|
| 110 |
-
"à": 105,
|
| 111 |
-
"á": 108,
|
| 112 |
-
"â": 104,
|
| 113 |
-
"ä": 128,
|
| 114 |
-
"ä̀": 55,
|
| 115 |
-
"ä́": 26,
|
| 116 |
-
"ä̂": 96,
|
| 117 |
-
"ä̌": 45,
|
| 118 |
-
"è": 112,
|
| 119 |
-
"é": 63,
|
| 120 |
-
"ê": 88,
|
| 121 |
-
"ë": 150,
|
| 122 |
-
"ë̀": 98,
|
| 123 |
-
"ë́": 83,
|
| 124 |
-
"ë̂": 52,
|
| 125 |
-
"ë̌": 48,
|
| 126 |
-
"ì": 9,
|
| 127 |
-
"í": 94,
|
| 128 |
-
"î": 7,
|
| 129 |
-
"ï": 138,
|
| 130 |
-
"ï̀": 153,
|
| 131 |
-
"ḯ": 54,
|
| 132 |
-
"ï̂": 123,
|
| 133 |
-
"ï̌": 87,
|
| 134 |
-
"ñ": 53,
|
| 135 |
-
"ñ'": 134,
|
| 136 |
-
"ò": 97,
|
| 137 |
-
"ó": 146,
|
| 138 |
-
"ô": 140,
|
| 139 |
-
"ö": 159,
|
| 140 |
-
"ö̀": 67,
|
| 141 |
-
"ö́": 89,
|
| 142 |
-
"ö̂": 56,
|
| 143 |
-
"ö̌": 62,
|
| 144 |
-
"ù": 79,
|
| 145 |
-
"ú": 24,
|
| 146 |
-
"û": 110,
|
| 147 |
-
"ü": 143,
|
| 148 |
-
"ǜ": 64,
|
| 149 |
-
"ǘ": 117,
|
| 150 |
-
"ü̂": 99,
|
| 151 |
-
"ǚ": 47,
|
| 152 |
-
"ý": 68,
|
| 153 |
-
"ě": 122,
|
| 154 |
-
"ō": 139,
|
| 155 |
-
"ǎ": 155,
|
| 156 |
-
"ǐ": 16,
|
| 157 |
-
"ǒ": 46,
|
| 158 |
-
"ǔ": 51,
|
| 159 |
-
"̀": 40,
|
| 160 |
-
"́": 149,
|
| 161 |
-
"̂": 132,
|
| 162 |
-
"̃": 17,
|
| 163 |
-
"̄": 22,
|
| 164 |
-
"̈": 37,
|
| 165 |
-
"̌": 144
|
| 166 |
-
}
|
| 167 |
-
}
|
|
|
|
| 1 |
+
{"mmc": {"t'": 0, "w": 1, "s'": 2, "jy": 3, "n'": 4, "p": 5, "M": 6, "\u00ee": 7, "S": 8, "\u00ec": 9, "C": 10, "q": 11, "\u00c0": 12, "sj": 13, "d": 14, "V": 15, "\u01d0": 16, "\u0303": 17, "e\u0304\u0301": 18, "u": 19, "i": 20, "a\u0304\u0301": 21, "\u0304": 22, "ndz": 23, "\u00fa": 24, "i\u0304\u030c": 25, "\u00e4\u0301": 26, "N": 28, "zh": 29, "J": 30, "u\u0304\u0301": 31, "l": 32, "chj": 33, "dy": 34, "tsj": 35, "G": 36, "\u0308": 37, "u\u0304\u0300": 38, "x": 39, "\u0300": 40, "o\u0304\u030c": 41, "ndzh": 42, "b": 43, "jn": 44, "\u00e4\u030c": 45, "\u01d2": 46, "\u00fc\u030c": 47, "\u00eb\u030c": 48, "tj": 49, "v": 50, "\u01d4": 51, "\u00eb\u0302": 52, "\u00f1": 53, "\u00ef\u0301": 54, "\u00e4\u0300": 55, "\u00f6\u0302": 56, "e\u0304": 57, "a\u0304\u0302": 58, "K": 59, "m": 60, "pj": 61, "\u00f6\u030c": 62, "\u00e9": 63, "\u00fc\u0300": 64, "i\u0304\u0302": 65, "o\u0304\u0302": 66, "\u00f6\u0300": 67, "\u00fd": 68, "jw": 69, "i\u0304": 70, "'": 71, "r": 72, "u\u0304\u030c": 73, "\u00b4": 74, "D": 75, "g": 76, "a\u0304\u030c": 77, "\u00d3": 78, "\u00f9": 79, "h": 80, "i\u0304\u0300": 81, "kj": 82, "\u00eb\u0301": 83, "E": 84, "y": 85, "j'": 86, "\u00ef\u030c": 87, "\u00ea": 88, "\u00f6\u0301": 89, "n": 90, "H": 91, "o\u0304": 92, "u\u0304\u0302": 93, "\u00ed": 94, "j\u00f1": 95, "\u00e4\u0302": 96, "\u00f2": 97, "\u00eb\u0300": 98, "\u00fc\u0302": 99, "t": 100, "o": 101, "a\u0304\u0300": 102, "A": 103, "\u00e2": 104, "\u00e0": 105, "Z": 106, "f": 107, "\u00e1": 108, "k": 109, "\u00fb": 110, "I": 111, "\u00e8": 112, "T": 113, ".": 114, "u\u0304": 115, "o\u0304\u0301": 116, "\u00fc\u0301": 117, "O": 118, "Y": 119, "\u00d1": 120, "L": 121, "\u011b": 122, "\u00ef\u0302": 123, "j": 124, "P": 125, "o\u0304\u0300": 126, "jm": 127, "\u00e4": 128, "m'": 129, "ts'": 130, "c": 131, "\u0302": 132, "'w": 133, "\u00f1'": 134, "k'": 135, "ch'": 136, "\u00cc": 137, "\u00ef": 138, "\u014d": 139, "\u00f4": 140, "a\u0304": 141, "e": 142, "\u00fc": 143, "\u030c": 144, "ch": 145, "\u00f3": 146, "B": 147, "X": 148, "\u0301": 149, "\u00eb": 150, "a": 151, "s": 152, "\u00ef\u0300": 153, "\u00cd": 154, "\u01ce": 155, "i\u0304\u0301": 156, "z": 157, "R": 158, "\u00f6": 159, "|": 27, "...": 160, "[UNK]": 161, "[PAD]": 162}}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|