Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,7 @@ pipeline_tag: audio-to-audio
|
|
| 6 |
|
| 7 |
<!-- Provide a quick summary of what the model is/does. -->
|
| 8 |
|
|
|
|
| 9 |
Despite recent advances in neural speech codecs, achieving high-fidelity speech reconstruction at low bitrates remains a formidable challenge. To address this limitation, we propose ESDCodec, a speech codec that integrates a thoroughly enhanced semantic quantizer and a conditioned decoder network. Specifically, we employ a randomly initialized and frozen codebook, followed by a lightweight projector, to encode semantic
|
| 10 |
details entirely within a linear space while enhancing codebook utilization. To further improve perceptual quality, we design a condition network
|
| 11 |
that injects prior subband knowledge into the upsampling decoder. Taking the de-quantized feature as input, this network predicts subband signals,
|
|
@@ -58,7 +59,7 @@ trainer.batch_size=3 \
|
|
| 58 |
data.segment_speech.segment_length=96000
|
| 59 |
```
|
| 60 |
|
| 61 |
-
##
|
| 62 |
This repo is directly based on the following excellent projects:
|
| 63 |
|
| 64 |
- [**DualCodec**](https://github.com/jiaqili3/DualCodec)
|
|
|
|
| 6 |
|
| 7 |
<!-- Provide a quick summary of what the model is/does. -->
|
| 8 |
|
| 9 |
+
## Abstract
|
| 10 |
Despite recent advances in neural speech codecs, achieving high-fidelity speech reconstruction at low bitrates remains a formidable challenge. To address this limitation, we propose ESDCodec, a speech codec that integrates a thoroughly enhanced semantic quantizer and a conditioned decoder network. Specifically, we employ a randomly initialized and frozen codebook, followed by a lightweight projector, to encode semantic
|
| 11 |
details entirely within a linear space while enhancing codebook utilization. To further improve perceptual quality, we design a condition network
|
| 12 |
that injects prior subband knowledge into the upsampling decoder. Taking the de-quantized feature as input, this network predicts subband signals,
|
|
|
|
| 59 |
data.segment_speech.segment_length=96000
|
| 60 |
```
|
| 61 |
|
| 62 |
+
## Acknowledgement
|
| 63 |
This repo is directly based on the following excellent projects:
|
| 64 |
|
| 65 |
- [**DualCodec**](https://github.com/jiaqili3/DualCodec)
|