| | --- |
| | library_name: transformers |
| | tags: [language-model, spoken-language, catastrophic-forgetting] |
| | --- |
| | |
| | # Model Description |
| |
|
| | This model is designed to address catastrophic forgetting in spoken language models during end-to-end training. It leverages innovative mitigation strategies to enhance model retention and performance over time. For more details, please refer to the paper by Hsiao et al. (2025) [here](https://arxiv.org/abs/2505.17496). |
| |
|
| | # Model Usage |
| |
|
| | To use this model, please check the [GitHub repository](https://github.com/chiyuanhsiao/ForgetSLM) for installation instructions, example code, and detailed usage guidelines. Ensure you have the required dependencies installed. |
| |
|
| |
|
| | # Citation |
| |
|
| | If you use this model in your research or applications, please cite it as follows: |
| |
|
| | **APA:** |
| | Hsiao, C.-Y., Lu, K.-H., Chang, K.-W., Yang, C.-K., Chen, W.-C., & Lee, H.-y. (2025). Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models. arXiv. https://arxiv.org/abs/2505.17496 |
| |
|
| | **BibTeX:** |
| | ``` |
| | @misc{hsiao2025analyzingmitigationstrategiescatastrophic, |
| | title={Analyzing Mitigation Strategies for Catastrophic Forgetting in End-to-End Training of Spoken Language Models}, |
| | author={Chi-Yuan Hsiao and Ke-Han Lu and Kai-Wei Chang and Chih-Kai Yang and Wei-Chih Chen and Hung-yi Lee}, |
| | year={2025}, |
| | eprint={2505.17496}, |
| | archivePrefix={arXiv}, |
| | primaryClass={cs.CL}, |
| | url={https://arxiv.org/abs/2505.17496}, |
| | } |
| | ``` |
