Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ model_name: EfficientConformerVietnamese
|
|
| 10 |
language: vi
|
| 11 |
---
|
| 12 |
|
| 13 |
-
# Efficient Conformer: Progressive Downsampling and Grouped Attention for Automatic Speech Recognition [Paper](https://arxiv.org/abs/2109.01163)
|
| 14 |
|
| 15 |
## Efficient Conformer Encoder
|
| 16 |
Inspired from previous works done in Automatic Speech Recognition and Computer Vision, the Efficient Conformer encoder is composed of three encoder stages where each stage comprises a number of Conformer blocks using grouped attention. The encoded sequence is progressively downsampled and projected to wider feature dimensions, lowering the amount of computation while achieving better performance. Grouped multi-head attention reduce attention complexity by grouping neighbouring time elements along the feature dimension before applying scaled dot-product attention.
|
|
|
|
| 10 |
language: vi
|
| 11 |
---
|
| 12 |
|
| 13 |
+
# Efficient Conformer: Progressive Downsampling and Grouped Attention for Automatic Speech Recognition [Paper](https://arxiv.org/abs/2109.01163)
|
| 14 |
|
| 15 |
## Efficient Conformer Encoder
|
| 16 |
Inspired from previous works done in Automatic Speech Recognition and Computer Vision, the Efficient Conformer encoder is composed of three encoder stages where each stage comprises a number of Conformer blocks using grouped attention. The encoded sequence is progressively downsampled and projected to wider feature dimensions, lowering the amount of computation while achieving better performance. Grouped multi-head attention reduce attention complexity by grouping neighbouring time elements along the feature dimension before applying scaled dot-product attention.
|