Commit
·
05144ba
1
Parent(s):
e5667c7
Update README.md
Browse files
README.md
CHANGED
|
@@ -15,8 +15,8 @@ This modelcard aims to be a base template for new models. It has been generated
|
|
| 15 |
### Model Description
|
| 16 |
|
| 17 |
<!-- Provide a longer summary of what this model is. -->
|
| 18 |
-
A
|
| 19 |
-
|
| 20 |
BERT was trained on text transcrition embeddings.
|
| 21 |
|
| 22 |
- **Developed by:** [More Information Needed]
|
|
@@ -31,14 +31,16 @@ BERT was trained on text transcrition embeddings.
|
|
| 31 |
|
| 32 |
<!-- Provide the basic links for the model. -->
|
| 33 |
|
| 34 |
-
- **Repository:** [
|
| 35 |
-
- **Paper [optional]:** [
|
| 36 |
-
- **Demo [optional]:** [
|
| 37 |
|
| 38 |
## Uses
|
| 39 |
|
| 40 |
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
|
|
|
| 41 |
|
|
|
|
| 42 |
### Direct Use
|
| 43 |
|
| 44 |
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
|
|
|
| 15 |
### Model Description
|
| 16 |
|
| 17 |
<!-- Provide a longer summary of what this model is. -->
|
| 18 |
+
A MultiModal architecture model that was created and finetuned jointly by concatenating Hubert and BERT embeddings.
|
| 19 |
+
Hubert model was fine-tuned with a classification head on preprocessed audio and emotion labels in supervised manner.
|
| 20 |
BERT was trained on text transcrition embeddings.
|
| 21 |
|
| 22 |
- **Developed by:** [More Information Needed]
|
|
|
|
| 31 |
|
| 32 |
<!-- Provide the basic links for the model. -->
|
| 33 |
|
| 34 |
+
- **Repository:** [https://github.com/netgvarun2012/VirtualTherapist/]
|
| 35 |
+
- **Paper [optional]:** [https://github.com/netgvarun2012/VirtualTherapist/blob/main/documentation/Speech_and_Text_based_MultiModal_Emotion_Recognizer.pdf]
|
| 36 |
+
- **Demo [optional]:** [https://huggingface.co/spaces/netgvarun2005/VirtualTherapist]
|
| 37 |
|
| 38 |
## Uses
|
| 39 |
|
| 40 |
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
| 41 |
+
'Virtual Therapist' app - an Intelligent speech and text input based assistant that can decipher emotions and generate therapeutic messages based on the Emotional state of the user.
|
| 42 |
|
| 43 |
+
Emotions recognized - Angry,Sad,Fearful,Happy,Disgusted,Surprised,Calm with ~80% accuracy.
|
| 44 |
### Direct Use
|
| 45 |
|
| 46 |
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|