Update README.md
Browse files
README.md
CHANGED
|
@@ -11,8 +11,62 @@ tags:
|
|
| 11 |
|
| 12 |
# StresSLM
|
| 13 |
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
-
|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
|
| 12 |
# StresSLM
|
| 13 |
|
| 14 |
+
**StresSLM** is an audio-text-to-text model fine-tuned with LoRA adapters on top of the [`Qwen/Qwen2-Audio-7B-Instruct`](https://huggingface.co/Qwen/Qwen2-Audio-7B-Instruct) base model. It is designed to tackle **Sentence Stress Detection (SSD)** and **Sentence Stress Reasoning (SSR)** tasks on the StressTest benchmark.
|
| 15 |
+
StresSLM predicts **stress patterns** and **reasoning** based on spoken audio.
|
| 16 |
+
For more information, see our paper and code:
|
| 17 |
|
| 18 |
+
📃 [StressTest Paper](https://arxiv.org/abs/2505.22765) | 💻 [Code](https://github.com/slp-rl/StressTest) | 🤗 [StressTest Dataset](https://huggingface.co/datasets/slprl/StressTest)
|
| 19 |
|
| 20 |
+
---
|
| 21 |
+
|
| 22 |
+
## 🎯 Model Overview
|
| 23 |
+
|
| 24 |
+
|
| 25 |
+
|
| 26 |
+
---
|
| 27 |
+
|
| 28 |
+
## 🔧 Usage
|
| 29 |
+
|
| 30 |
+
This model can be loaded using the HuggingFace Transformers library:
|
| 31 |
+
|
| 32 |
+
```python
|
| 33 |
+
from transformers import AutoProcessor, Qwen2AudioForConditionalGeneration
|
| 34 |
+
from peft import PeftModel, PeftConfig
|
| 35 |
+
|
| 36 |
+
# Load processor
|
| 37 |
+
processor = AutoProcessor.from_pretrained("Qwen/Qwen2-Audio-7B-Instruct")
|
| 38 |
+
|
| 39 |
+
# Load LoRA config and base model
|
| 40 |
+
peft_config = PeftConfig.from_pretrained("slprl/StresSLM")
|
| 41 |
+
base_model = Qwen2AudioForConditionalGeneration.from_pretrained(peft_config.base_model_name_or_path)
|
| 42 |
+
|
| 43 |
+
# Load LoRA adapter
|
| 44 |
+
model = PeftModel.from_pretrained(base_model, "slprl/StresSLM")
|
| 45 |
+
```
|
| 46 |
+
|
| 47 |
+
---
|
| 48 |
+
|
| 49 |
+
## Tasks
|
| 50 |
+
|
| 51 |
+
* **Sentence Stress Detection (SSD)**: Identify stressed words in an utterance.
|
| 52 |
+
* **Sentence Stress Reasoning (SSR)**: Reason about the speaker’s intention using stress patterns.
|
| 53 |
+
|
| 54 |
+
For evaluation scripts and benchmarks, refer to the [StressTest GitHub repository](https://github.com/slp-rl/StressTest).
|
| 55 |
+
|
| 56 |
+
---
|
| 57 |
+
|
| 58 |
+
## 📖 Citation
|
| 59 |
+
|
| 60 |
+
If you use this model, please cite:
|
| 61 |
|
| 62 |
+
```bibtex
|
| 63 |
+
@misc{yosha2025stresstest,
|
| 64 |
+
title={StressTest: Can YOUR Speech LM Handle the Stress?},
|
| 65 |
+
author={Iddo Yosha and Gallil Maimon and Yossi Adi},
|
| 66 |
+
year={2025},
|
| 67 |
+
eprint={2505.22765},
|
| 68 |
+
archivePrefix={arXiv},
|
| 69 |
+
primaryClass={cs.CL},
|
| 70 |
+
url={https://arxiv.org/abs/2505.22765},
|
| 71 |
+
}
|
| 72 |
+
```
|