Audio Classification
Transformers
Safetensors
Spanish
wav2vec2-bert
emotion-recognition
speech-emotion-recognition
speech-processing
spanish
affective-computing
umuteam
Eval Results (legacy)
Instructions to use UMUTeam/w2v-bert-emotion-es with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use UMUTeam/w2v-bert-emotion-es with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("audio-classification", model="UMUTeam/w2v-bert-emotion-es")# Load model directly from transformers import AutoProcessor, CustomAudioClassification processor = AutoProcessor.from_pretrained("UMUTeam/w2v-bert-emotion-es") model = CustomAudioClassification.from_pretrained("UMUTeam/w2v-bert-emotion-es", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
#2
by tomasBernal - opened
README.md
CHANGED
|
@@ -114,11 +114,17 @@ https://github.com/NLP-UMUTeam/umuteam-speech-emotion
|
|
| 114 |
|
| 115 |
The model was evaluated on the Spanish held-out test set used in the `speech-emotion` toolkit.
|
| 116 |
|
| 117 |
-
|
| 118 |
-
|---|---:|---:|---:|---:|---:|
|
| 119 |
-
| Spanish | Speech | 88.1207 | 88.3244 | 88.1357 | 84.4829 |
|
| 120 |
|
| 121 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 122 |
|
| 123 |
## How to use
|
| 124 |
|
|
|
|
| 114 |
|
| 115 |
The model was evaluated on the Spanish held-out test set used in the `speech-emotion` toolkit.
|
| 116 |
|
| 117 |
+
### Performance comparison on Spanish emotion recognition
|
|
|
|
|
|
|
| 118 |
|
| 119 |
+
| Configuration | Accuracy | Weighted Precision | Weighted F1 | Macro F1 |
|
| 120 |
+
|---|---:|---:|---:|---:|
|
| 121 |
+
| Speech-only | 88.1207 | 88.3244 | 88.1357 | 84.4829 |
|
| 122 |
+
| Text-only | 77.0204 | 77.0449 | 76.8367 | 69.3886 |
|
| 123 |
+
| Multimodal (Concat) | **90.0682** | **90.2048** | **90.0642** | **87.7455** |
|
| 124 |
+
| Multimodal (Mean) | 88.5102 | 88.6163 | 88.5011 | 84.1653 |
|
| 125 |
+
| Multimodal (Multihead) | 82.6680 | 82.3820 | 82.4600 | 75.5606 |
|
| 126 |
+
|
| 127 |
+
These results show that speech-based emotion recognition provides strong performance for Spanish emotion analysis, while multimodal approaches combining speech and text achieve even higher robustness and overall performance.
|
| 128 |
|
| 129 |
## How to use
|
| 130 |
|