YatharthS commited on
Commit
f29c718
·
verified ·
1 Parent(s): 6aa570c

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ language:
4
+ - en
5
+ ---
6
+ ## Linacodec: Highly compressive audio tokenizer for speech models.
7
+ <p align="center">
8
+ <a href="https://huggingface.co/YatharthS/LinaCodec">
9
+ <img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-FFD21E" alt="Hugging Face Model">
10
+ </a>
11
+ </p>
12
+
13
+ Linacodec is an audio tokenizer that compresses audio into just 12.5 tokens per second (171 bps) and decodes to 48khz audio!
14
+
15
+ ### Key benefits
16
+ * Compression: 12.5 tokens/sec (60x more compressed than DAC).
17
+ * Audio Quality: 48khz output (much clearer then 16khz/24khz which is the standard).
18
+ * Encoder Speed: 200x realtime.
19
+ * Decoder Speed: 400x realtime(even faster with batching)
20
+ * Many Tasks: Indirectly even supports voice conversion, audio super-resolution, and audio denoising!
21
+
22
+ ### Why is this even useful?
23
+ Audio tokenizers directly contribute to speed, quality, and capability. LinaCodec massively improves upon previous codecs.
24
+ * Inference Speed: Enables TTS models to run 800x realtime, 8x faster than [MiraTTS](https://github.com/ysharma3501)!
25
+ * Fast training: High-quality TTS models can be trained in less then 1 day.
26
+ * Versatile: Works for both Text-to-Speech and Speech-to-Text unlike most other codecs.
27
+
28
+ ### Comparisons
29
+ | Model | Total Tokens/Sec | Sample Rate |
30
+ | :--- | :--- | :--- |
31
+ | Linacodec | 12.5 | 48khz |
32
+ | DAC | 774 | 44.1khz |
33
+ | EnCodec | 300 | 24khz |
34
+ | Xcodec2 | 50 | 16khz |
35
+ | Mimi | 200 | 24khz |
36
+
37
+ Please check the repo for usage: https://github.com/johnwick123f/LinaCodec
38
+
39
+ Licence is CC-BY-4.0 meaning you can use it for any usecase(commercially/non-commercially) given you credit the original creator. Thank you.