Synesthesia / docs /CONCEPTS.md
Ashiedu's picture
Sync unified workbench
0490201 verified

A newer version of the Gradio SDK is available: 6.14.0

Upgrade

Concepts

Real-Time Factor (RTF)

The Real-Time Factor (RTF) is a performance metric used to evaluate the delay between input and output, expressed as a ratio to real time.

Example:

RTF = Processing Time / Input Duration

Latency

Latency refers to the time taken for the system to process a given input and generate the corresponding output.

Example: A latency of 30ms can mean a significant delay in real-time applications.

Control Delay

Control Delay is the time between the detection of an event and the start of its corresponding response.

Example: Control Delay can be influenced by both software and hardware factors.

SpectroStream Codec

The SpectroStream codec allows for efficient streaming and encoding of audio data. It supports various sampling rates and bit depths to ensure quality playback.

Chunk-Based Autoregression

Chunk-based autoregression breaks the audio signal into manageable chunks for better processing accuracy and efficiency.

Audio Injection Modes

Audio Injection modes define how audio data can be input into the system for processing.

Diagrams

 _____________________ 
|                     |
|    Audio Source     |
|_____________________|
           |   
           |   RTF
           |   
 __________|___________ 
|                     |
|   Audio Processing   |
|_____________________|
           |   
           |   Output Signal
           |   
 __________|___________ 
|                     |
|    Audio Output     |
|_____________________|