File size: 940 Bytes
7801a90 2686f42 7801a90 2686f42 7801a90 2686f42 7801a90 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 | ---
license: mit
language:
- en
metrics:
- accuracy
- f1
- precision
base_model:
- bhadresh-savani/distilbert-base-uncased-emotion
pipeline_tag: audio-classification
tags:
- speech
- emotion
- ser
- classification
---
# TuBERT: Multimodal Speech Emotion Recognition For Real-Time Avatar Control
*This project was developed for my senior thesis at Princeton University. Paper being published soon.*
## About
TuBERT is a multimodal speech emotion recognition model that runs in real-time and on-device. I designed it with PNGTubers in mind, but there are plenty of other applications for it as well!
To test the model for yourself using a GUI, see the [GitHub repository](https://github.com/YacoubKahkajian/TuBERT) for installation instructions.
## Usage
`tubert.pt` is the base TuBERT model trained on MELD, described in the paper and used by default for evaluation. `tubert_iemocap.pt` is the version of the model fine-tuned on IEMOCAP. |