maple / README.md
Lyu-1211's picture
Upload README.md with huggingface_hub
05d9e9a verified
|
Raw History Blame Contribute Delete
1.5 kB
---
license: other
license_name: maple-research-license
license_link: https://huggingface.co/Lyu-1211/maple/blob/main/LICENSE
language:
- zh
tags:
- pytorch
- multimodal
- dysarthria
---
# MAPLE
[![GitHub Code](https://img.shields.io/badge/GitHub-Code-181717?logo=github&logoColor=white)](https://github.com/LYU-zhuxi/-MAPLE)
![MAPLE overview](./Fig1.png)
Official checkpoints for **MAPLE: Multi-layer pathology modeling and sparse expert fusion for audio-visual dysarthria severity assessment**.
Trained on MSDM, MAPLE combines multi-layer audio and visual representations with a static expert, a synergy expert, and a sparse router. It predicts four severity levels: **0: Normal, 1: Mild, 2: Moderate, 3: Severe**.
## Checkpoints
```text
maple_best/
|-- audio/best.pt
|-- video/best.pt
|-- static/best.pt
|-- synergy/best.pt
`-- router/best.pt
```
## Usage
Set up the environment following the [code repository](https://github.com/LYU-zhuxi/-MAPLE#-quick-start), then run from its root:
```bash
hf download Lyu-1211/maple --include "maple_best/*" --local-dir checkpoints
```
## License
The released MAPLE checkpoints are provided under the [MAPLE Research License](https://huggingface.co/Lyu-1211/maple/blob/main/LICENSE) for non-commercial academic research only. MSDM data and third-party models remain subject to their respective terms; this license grants no rights to those resources.
## Citation
If you find our work helpful, feel free to give us a cite.
```text
```