ChristophSchuhmann commited on
Commit
9ceb459
·
verified ·
1 Parent(s): ffc084d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -69,6 +69,37 @@ The quality scores are distilled from two established audio quality models:
69
  | Content Enjoyment | 0.34 | 0.691 | 200 |
70
 
71
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72
  ## How to Use
73
 
74
  ### Full Inference: Emotion Scores + Quality Scores
 
69
  | Content Enjoyment | 0.34 | 0.691 | 200 |
70
 
71
 
72
+ ### Group: Vocal, Demographic, and Psychological Attributes
73
+
74
+ These 12 continuous dimensions capture the stylistic delivery, demographic traits, energetic state, and interpersonal tone of the speaker. They use varying scales to represent shifts from a neutral baseline.
75
+
76
+ | Dimension | Scale Type | Range (Neutral) | Description |
77
+ | --- | --- | --- | --- |
78
+ | **Age** | Unipolar | 0 to 6 (-) | Estimated age from 0 (Infant/Toddler) to 6 (Very Old), e.g., 2=Teenager, 4=Adult. |
79
+ | **Gender** | Bipolar | -2 to +2 (0) | Perceived gender representation, from Very Masculine (-2) to Very Feminine (+2). |
80
+ | **Pitch (High vs. Low)** | Unipolar | 0 to 4 (2) | The fundamental frequency baseline, from Very High-Pitched (0) to Very Low-Pitched (4). |
81
+ | **Talking Speed** | Custom | 0 to 36+ CPS (-) | The speech rate measured in Characters Per Second (CPS). |
82
+ | **Valence** | Bipolar | -3 to +3 (0) | The overall positivity or negativity of the voice. |
83
+ | **Arousal** | Unipolar | 0 to 4 (2) | The energy level of the speaker, ranging from very calm (0) to very excited (4). |
84
+ | **Submissive vs. Dominant** | Bipolar | -3 to +3 (0) | The perceived authority or submission in the speaker's tone. |
85
+ | **Serious vs. Humorous** | Unipolar | 0 to 4 (2) | The degree of humor or gravity in the delivery. |
86
+ | **Confident vs. Hesitant** | Unipolar | 0 to 4 (2) | How certain or unsure the speaker sounds. |
87
+ | **Soft vs. Harsh** | Bipolar | -2 to +2 (0) | The acoustic texture of the voice, from soothing and soft to abrasive and harsh. |
88
+ | **Monotone vs. Expressive** | Unipolar | 0 to 4 (2) | The amount of dynamic pitch and rhythmic variation in the speech. |
89
+ | **Warm vs. Cold** | Bipolar | -2 to +2 (0) | The perceived friendliness, empathy, or distance in the speaker's voice. |
90
+
91
+ ### Group: Emotional Categories
92
+
93
+ Our dataset includes granular annotations for **40 distinct emotional categories** (e.g., *Joy, Anger, Gratitude, Sadness, Surprise*).
94
+
95
+ > **Note on Sequence Length:** To manage sequence length and model focus, we condition **only on the top 5 most prominent emotions** present in any given audio sample.
96
+
97
+ | Dimension Group | Scale Type | Range | Description |
98
+ | --- | --- | --- | --- |
99
+ | **40 Emotions** | Unipolar | 0 to 4 (Max 4.5) | Represents the intensity of a specific emotion. `0` means the emotion is completely absent, while `4+` indicates extreme manifestation. |
100
+
101
+
102
+
103
  ## How to Use
104
 
105
  ### Full Inference: Emotion Scores + Quality Scores