muk-luganda-digits-classification-clean

README.md

@@ -0,0 +1,111 @@
+---
+library_name: transformers
+license: apache-2.0
+base_model: facebook/wav2vec2-base
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+model-index:
+- name: muk-luganda-digits-classification-clean
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# muk-luganda-digits-classification-clean
+
+This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 3.2912
+- Accuracy: 0.4444
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 3e-05
+- train_batch_size: 4
+- eval_batch_size: 1
+- seed: 42
+- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 50
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|
+| 2.3031        | 1.0   | 54   | 2.3087          | 0.1111   |
+| 2.2996        | 2.0   | 108  | 2.3192          | 0.0370   |
+| 2.2895        | 3.0   | 162  | 2.3097          | 0.0741   |
+| 2.2775        | 4.0   | 216  | 2.3196          | 0.0741   |
+| 2.2559        | 5.0   | 270  | 2.3122          | 0.1852   |
+| 2.2087        | 6.0   | 324  | 2.2864          | 0.1481   |
+| 2.1098        | 7.0   | 378  | 2.2359          | 0.2222   |
+| 2.0347        | 8.0   | 432  | 2.1798          | 0.2222   |
+| 1.8935        | 9.0   | 486  | 2.0581          | 0.3333   |
+| 1.8424        | 10.0  | 540  | 2.0617          | 0.3333   |
+| 1.6853        | 11.0  | 594  | 2.0774          | 0.3333   |
+| 1.6062        | 12.0  | 648  | 1.9688          | 0.4074   |
+| 1.4425        | 13.0  | 702  | 1.8905          | 0.4444   |
+| 1.3637        | 14.0  | 756  | 1.8887          | 0.4074   |
+| 1.2574        | 15.0  | 810  | 1.8752          | 0.4444   |
+| 1.1705        | 16.0  | 864  | 1.8439          | 0.4815   |
+| 1.0439        | 17.0  | 918  | 1.8602          | 0.4074   |
+| 0.9871        | 18.0  | 972  | 1.7512          | 0.4074   |
+| 0.949         | 19.0  | 1026 | 2.0009          | 0.3704   |
+| 0.8252        | 20.0  | 1080 | 2.0860          | 0.4444   |
+| 0.7124        | 21.0  | 1134 | 1.8057          | 0.4815   |
+| 0.6594        | 22.0  | 1188 | 1.9824          | 0.4074   |
+| 0.5448        | 23.0  | 1242 | 2.3564          | 0.3333   |
+| 0.502         | 24.0  | 1296 | 2.0142          | 0.4444   |
+| 0.4108        | 25.0  | 1350 | 2.1864          | 0.4074   |
+| 0.4095        | 26.0  | 1404 | 2.4376          | 0.4074   |
+| 0.3495        | 27.0  | 1458 | 2.5146          | 0.4444   |
+| 0.2818        | 28.0  | 1512 | 2.3985          | 0.4444   |
+| 0.3269        | 29.0  | 1566 | 2.7282          | 0.4444   |
+| 0.2856        | 30.0  | 1620 | 2.2764          | 0.4815   |
+| 0.2542        | 31.0  | 1674 | 2.5317          | 0.4444   |
+| 0.2205        | 32.0  | 1728 | 2.4492          | 0.4444   |
+| 0.2585        | 33.0  | 1782 | 3.0590          | 0.4074   |
+| 0.2258        | 34.0  | 1836 | 2.7979          | 0.4444   |
+| 0.1818        | 35.0  | 1890 | 2.6064          | 0.4815   |
+| 0.1975        | 36.0  | 1944 | 2.7659          | 0.4444   |
+| 0.2536        | 37.0  | 1998 | 2.8510          | 0.4444   |
+| 0.1456        | 38.0  | 2052 | 2.8677          | 0.4444   |
+| 0.2197        | 39.0  | 2106 | 3.1799          | 0.4074   |
+| 0.2195        | 40.0  | 2160 | 3.1353          | 0.4074   |
+| 0.1617        | 41.0  | 2214 | 2.9508          | 0.4815   |
+| 0.2328        | 42.0  | 2268 | 3.0263          | 0.4815   |
+| 0.1884        | 43.0  | 2322 | 2.8975          | 0.4444   |
+| 0.2127        | 44.0  | 2376 | 2.9817          | 0.4815   |
+| 0.1545        | 45.0  | 2430 | 3.1183          | 0.4444   |
+| 0.166         | 46.0  | 2484 | 3.1063          | 0.4444   |
+| 0.1659        | 47.0  | 2538 | 3.2661          | 0.4444   |
+| 0.1923        | 48.0  | 2592 | 3.2802          | 0.4074   |
+| 0.2008        | 49.0  | 2646 | 3.2903          | 0.4444   |
+| 0.1849        | 50.0  | 2700 | 3.2912          | 0.4444   |
+
+
+### Framework versions
+
+- Transformers 4.56.2
+- Pytorch 2.8.0+cu128
+- Datasets 3.6.0
+- Tokenizers 0.22.1

config.json

@@ -0,0 +1,141 @@
+{
+  "activation_dropout": 0.0,
+  "adapter_attn_dim": null,
+  "adapter_kernel_size": 3,
+  "adapter_stride": 2,
+  "add_adapter": false,
+  "apply_spec_augment": true,
+  "architectures": [
+    "Wav2Vec2ForSequenceClassification"
+  ],
+  "attention_dropout": 0.1,
+  "bos_token_id": 1,
+  "classifier_proj_size": 256,
+  "codevector_dim": 256,
+  "contrastive_logits_temperature": 0.1,
+  "conv_bias": false,
+  "conv_dim": [
+    512,
+    512,
+    512,
+    512,
+    512,
+    512,
+    512
+  ],
+  "conv_kernel": [
+    10,
+    3,
+    3,
+    3,
+    3,
+    2,
+    2
+  ],
+  "conv_stride": [
+    5,
+    2,
+    2,
+    2,
+    2,
+    2,
+    2
+  ],
+  "ctc_loss_reduction": "sum",
+  "ctc_zero_infinity": false,
+  "diversity_loss_weight": 0.1,
+  "do_stable_layer_norm": false,
+  "dtype": "float32",
+  "eos_token_id": 2,
+  "feat_extract_activation": "gelu",
+  "feat_extract_norm": "group",
+  "feat_proj_dropout": 0.1,
+  "feat_quantizer_dropout": 0.0,
+  "final_dropout": 0.0,
+  "freeze_feat_extract_train": true,
+  "hidden_act": "gelu",
+  "hidden_dropout": 0.1,
+  "hidden_size": 768,
+  "id2label": {
+    "0": "notti",
+    "1": "emu",
+    "2": "bbiri",
+    "3": "ssatu",
+    "4": "nnya",
+    "5": "ttaano",
+    "6": "mukaaga",
+    "7": "musanvu",
+    "8": "munaana",
+    "9": "mwenda"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "label2id": {
+    "bbiri": 2,
+    "emu": 1,
+    "mukaaga": 6,
+    "munaana": 8,
+    "musanvu": 7,
+    "mwenda": 9,
+    "nnya": 4,
+    "notti": 0,
+    "ssatu": 3,
+    "ttaano": 5
+  },
+  "layer_norm_eps": 1e-05,
+  "layerdrop": 0.0,
+  "mask_channel_length": 10,
+  "mask_channel_min_space": 1,
+  "mask_channel_other": 0.0,
+  "mask_channel_prob": 0.0,
+  "mask_channel_selection": "static",
+  "mask_feature_length": 10,
+  "mask_feature_min_masks": 0,
+  "mask_feature_prob": 0.0,
+  "mask_time_length": 10,
+  "mask_time_min_masks": 2,
+  "mask_time_min_space": 1,
+  "mask_time_other": 0.0,
+  "mask_time_prob": 0.05,
+  "mask_time_selection": "static",
+  "model_type": "wav2vec2",
+  "no_mask_channel_overlap": false,
+  "no_mask_time_overlap": false,
+  "num_adapter_layers": 3,
+  "num_attention_heads": 12,
+  "num_codevector_groups": 2,
+  "num_codevectors_per_group": 320,
+  "num_conv_pos_embedding_groups": 16,
+  "num_conv_pos_embeddings": 128,
+  "num_feat_extract_layers": 7,
+  "num_hidden_layers": 12,
+  "num_negatives": 100,
+  "output_hidden_size": 768,
+  "pad_token_id": 0,
+  "proj_codevector_dim": 256,
+  "tdnn_dilation": [
+    1,
+    2,
+    3,
+    1,
+    1
+  ],
+  "tdnn_dim": [
+    512,
+    512,
+    512,
+    512,
+    1500
+  ],
+  "tdnn_kernel": [
+    5,
+    3,
+    3,
+    1,
+    1
+  ],
+  "transformers_version": "4.56.2",
+  "use_weighted_layer_sum": false,
+  "vocab_size": 32,
+  "xvector_output_dim": 512
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:49dd6410b582dc09dc72d8f4fc85ce22a9b88e2764fae23fe2a763c8240ee4fe
+size 378310592

preprocessor_config.json

@@ -0,0 +1,9 @@
+{
+  "do_normalize": true,
+  "feature_extractor_type": "Wav2Vec2FeatureExtractor",
+  "feature_size": 1,
+  "padding_side": "right",
+  "padding_value": 0.0,
+  "return_attention_mask": false,
+  "sampling_rate": 16000
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:55bcf331244893a24d3f31a7684942dce2937919831b33593940feba99dcb87e
+size 5841