Instructions to use yxdu/ESRT-4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use yxdu/ESRT-4B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="yxdu/ESRT-4B", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("yxdu/ESRT-4B", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Add metadata and improve model card
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,9 +1,17 @@
|
|
| 1 |
-
|
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
-
#
|
|
|
|
|
|
|
| 4 |
|
| 5 |
ESRT supports many-to-many speech-to-text translation across **45 languages** (45 × 44 directions). It uses an edge-cloud split inference architecture to protect voice privacy and reduce bandwidth by transmitting only compressed acoustic features instead of raw audio.
|
| 6 |
|
|
|
|
|
|
|
|
|
|
| 7 |
[](https://arxiv.org/abs/2605.28642)
|
| 8 |
[](https://huggingface.co/yxdu/ESRT-4B)
|
| 9 |
|
|
@@ -65,4 +73,4 @@ Training code will be open-sourced in a future release. Validated on:
|
|
| 65 |
primaryClass={cs.AI},
|
| 66 |
url={https://arxiv.org/abs/2605.28642},
|
| 67 |
}
|
| 68 |
-
```
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: transformers
|
| 3 |
+
pipeline_tag: automatic-speech-recognition
|
| 4 |
+
---
|
| 5 |
|
| 6 |
+
# ESRT: Edge-cloud Speech Recognition and Translation
|
| 7 |
+
|
| 8 |
+
This repository contains the weights for ESRT-4B, as presented in the paper [Bandwidth-Efficient and Privacy-Preserving Edge-Cloud Many-to-Many Speech Translation](https://huggingface.co/papers/2605.28642).
|
| 9 |
|
| 10 |
ESRT supports many-to-many speech-to-text translation across **45 languages** (45 × 44 directions). It uses an edge-cloud split inference architecture to protect voice privacy and reduce bandwidth by transmitting only compressed acoustic features instead of raw audio.
|
| 11 |
|
| 12 |
+
- **Paper:** [arXiv:2605.28642](https://arxiv.org/abs/2605.28642)
|
| 13 |
+
- **Code:** [https://github.com/yxduir/esrt](https://github.com/yxduir/esrt)
|
| 14 |
+
|
| 15 |
[](https://arxiv.org/abs/2605.28642)
|
| 16 |
[](https://huggingface.co/yxdu/ESRT-4B)
|
| 17 |
|
|
|
|
| 73 |
primaryClass={cs.AI},
|
| 74 |
url={https://arxiv.org/abs/2605.28642},
|
| 75 |
}
|
| 76 |
+
```
|