Update README.md
#1
by
reach-vb
- opened
README.md
CHANGED
|
@@ -10,8 +10,8 @@ SeamlessM4T is designed to provide high quality translation, allowing people fro
|
|
| 10 |
|
| 11 |
SeamlessM4T covers:
|
| 12 |
- 📥 101 languages for speech input
|
| 13 |
-
- ⌨️
|
| 14 |
-
- 🗣️
|
| 15 |
|
| 16 |
This unified model enables multiple tasks without relying on multiple separate models:
|
| 17 |
- Speech-to-speech translation (S2ST)
|
|
@@ -23,13 +23,15 @@ This unified model enables multiple tasks without relying on multiple separate m
|
|
| 23 |
## SeamlessM4T models
|
| 24 |
| Model Name | #params | checkpoint | metrics |
|
| 25 |
| - | - | - | - |
|
| 26 |
-
| SeamlessM4T-Large | 2.3B |[
|
| 27 |
-
| SeamlessM4T-Medium | 1.2B |[
|
| 28 |
|
| 29 |
We provide the extensive evaluation results of seamlessM4T-Large and SeamlessM4T-Medium reported in the paper (as averages) in the `metrics` files above.
|
| 30 |
|
| 31 |
## Instructions to run inference with SeamlessM4T models
|
| 32 |
|
|
|
|
|
|
|
| 33 |
Inference calls for the `Translator` object instanciated with a Multitasking UnitY model with the options:
|
| 34 |
- `multitask_unity_large`
|
| 35 |
- `multitask_unity_medium`
|
|
|
|
| 10 |
|
| 11 |
SeamlessM4T covers:
|
| 12 |
- 📥 101 languages for speech input
|
| 13 |
+
- ⌨️ 96 Languages for text input/output
|
| 14 |
+
- 🗣️ 35 languages for speech output.
|
| 15 |
|
| 16 |
This unified model enables multiple tasks without relying on multiple separate models:
|
| 17 |
- Speech-to-speech translation (S2ST)
|
|
|
|
| 23 |
## SeamlessM4T models
|
| 24 |
| Model Name | #params | checkpoint | metrics |
|
| 25 |
| - | - | - | - |
|
| 26 |
+
| SeamlessM4T-Large | 2.3B |[🤗 Model card](https://huggingface.co/facebook/seamless-m4t-large) - [checkpoint](https://huggingface.co/facebook/seamless-m4t-large/resolve/main/multitask_unity_large.pt) | [metrics]() |
|
| 27 |
+
| SeamlessM4T-Medium | 1.2B |[🤗 Model card](https://huggingface.co/facebook/seamless-m4t-medium) - [checkpoint](https://huggingface.co/facebook/seamless-m4t-medium/resolve/main/multitask_unity_medium.pt) | [metrics]() |
|
| 28 |
|
| 29 |
We provide the extensive evaluation results of seamlessM4T-Large and SeamlessM4T-Medium reported in the paper (as averages) in the `metrics` files above.
|
| 30 |
|
| 31 |
## Instructions to run inference with SeamlessM4T models
|
| 32 |
|
| 33 |
+
Install `seamless_communication` by following the instructions mentioned here: [Installation](https://github.com/fairinternal/seamless_communication/tree/main#installation)
|
| 34 |
+
|
| 35 |
Inference calls for the `Translator` object instanciated with a Multitasking UnitY model with the options:
|
| 36 |
- `multitask_unity_large`
|
| 37 |
- `multitask_unity_medium`
|