Update README.md

README.md

@@ -30,6 +30,58 @@ Training follows the GAN objective as in the original Vocos, while adopting loss
 
 ---
 
+## ⚡ Streaming Latency & Real-Time Performance
+
+We benchmark **Streaming Vocos** in **streaming inference mode** using chunked mel-spectrogram decoding on both CPU and GPU.
+
+### Benchmark setup
+
+- **Audio duration:** 3.24 s  
+- **Sample rate:** 16 kHz  
+- **Mel hop size:** 320 samples (20 ms per mel frame)  
+- **Chunk size:** 5 mel frames (100 ms buffering latency)  
+- **Runs:** 100 warm-up + 1000 timed runs  
+- **Inference mode:** Streaming (stateful causal decoding)  
+
+**Metrics**
+- **Processing time per chunk**
+- **End-to-end latency** = chunk buffering + processing time
+- **RTF (Real-Time Factor)** = processing time / audio duration
+
+---
+
+### Results
+
+#### Streaming performance (chunk size = 5 frames, 100 ms buffer)
+
+| Device | Avg proc / chunk | First-chunk proc | End-to-end latency | Total proc (3.2 s audio) | RTF |
+|------|------------------|------------------|--------------------|---------------------------|-----|
+| **CPU** | 14.0 ms | 14.0 ms | **114.0 ms** | 464 ms | 0.14 |
+| **GPU (CUDA)** | **3.4 ms** | **3.3 ms** | **103.3 ms** | **113 ms** | **0.035** |
+
+> End-to-end latency includes the **100 ms chunk buffering delay** required for streaming inference.
+
+---
+
+### Interpretation
+
+- **Real-time capable on CPU**  
+  Streaming Vocos achieves an RTF of approximately **0.14**, corresponding to inference running ~7× faster than real time.
+
+- **Ultra-low compute overhead on GPU**  
+  Chunk processing time is reduced to **~3.4 ms**, making overall latency dominated by buffering rather than computation.
+
+- **Streaming-friendly first-chunk behavior**  
+  First-chunk latency closely matches steady-state latency, indicating **no cold-start penalty** during streaming inference.
+
+- **Latency–quality tradeoff**  
+  Smaller chunk sizes further reduce buffering latency (e.g., 1–2 frames → <40 ms), at the cost of slightly increased computational overhead.
+
+---
+
+With a **chunk size of 1 frame (20 ms buffering)**, GPU end-to-end latency drops below **25 ms**, making **Streaming Vocos** suitable for **interactive and conversational TTS pipelines**.
+
+
 ## Checkpoints
 
 This repo provides a PyTorch Lightning checkpoint: