vspeech commited on
Commit
0a88a53
·
verified ·
1 Parent(s): 0395482

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -6,6 +6,7 @@ pipeline_tag: audio-to-audio
6
 
7
  <!-- Provide a quick summary of what the model is/does. -->
8
 
 
9
  Despite recent advances in neural speech codecs, achieving high-fidelity speech reconstruction at low bitrates remains a formidable challenge. To address this limitation, we propose ESDCodec, a speech codec that integrates a thoroughly enhanced semantic quantizer and a conditioned decoder network. Specifically, we employ a randomly initialized and frozen codebook, followed by a lightweight projector, to encode semantic
10
  details entirely within a linear space while enhancing codebook utilization. To further improve perceptual quality, we design a condition network
11
  that injects prior subband knowledge into the upsampling decoder. Taking the de-quantized feature as input, this network predicts subband signals,
@@ -58,7 +59,7 @@ trainer.batch_size=3 \
58
  data.segment_speech.segment_length=96000
59
  ```
60
 
61
- ### Acknowledgement
62
  This repo is directly based on the following excellent projects:
63
 
64
  - [**DualCodec**](https://github.com/jiaqili3/DualCodec)
 
6
 
7
  <!-- Provide a quick summary of what the model is/does. -->
8
 
9
+ ## Abstract
10
  Despite recent advances in neural speech codecs, achieving high-fidelity speech reconstruction at low bitrates remains a formidable challenge. To address this limitation, we propose ESDCodec, a speech codec that integrates a thoroughly enhanced semantic quantizer and a conditioned decoder network. Specifically, we employ a randomly initialized and frozen codebook, followed by a lightweight projector, to encode semantic
11
  details entirely within a linear space while enhancing codebook utilization. To further improve perceptual quality, we design a condition network
12
  that injects prior subband knowledge into the upsampling decoder. Taking the de-quantized feature as input, this network predicts subband signals,
 
59
  data.segment_speech.segment_length=96000
60
  ```
61
 
62
+ ## Acknowledgement
63
  This repo is directly based on the following excellent projects:
64
 
65
  - [**DualCodec**](https://github.com/jiaqili3/DualCodec)