mlobdell-synaptics's picture
add initial files and update readme (#1)
aa08d9b
|
Raw
History Blame Contribute Delete
2.69 kB
metadata
library_name: torq
tags:
  - Automatic Speech Recognition
  - Astra SL
  - SL2600
  - MPU
license: mit
base_model:
  - UsefulSensors/moonshine-streaming-tiny
base_model_relation: quantized

Moonshine Streaming Tiny

Model Overview

Moonshine is a high-efficiency automatic speech recognition (ASR) model designed specifically for real-time speech recognition. Unlike Whisper, which processes audio in fixed 30-second chunks, Moonshine uses a variable-length architecture that only computes the actual duration of the speech received.

Useful Sensors developed Moonshine and released the English model as open-source. There are 2 models of different sizes and capabilities - base and tiny. The tiny version utilizes 27M parameters.

Moonshine Streaming Tiny is based on Moonshine V2, released in 2026, introduced sliding window attention in the encoder part of the model. This means we no longer need to wait for the full-length of speech to start emitting the first token, reducing the time-to-first-token (TTFT) as the encoder can now "stream" the encoding frames to the decoder.

Model Features

  • Model Type: Automatic Speech Recognition
  • Input: Raw waveform (1D array of floats) 16kHz mono audio up to 30 seconds
  • Output: Sequence of token IDs (integers)
  • Quantization: None

Recommended Platforms

  • Synaptics Astra™ SL2600-Series with Torq

Metrics

Platform Model / Stage Environment Inference Time Infer / s
SL2610 Moonshine Tiny Decoder Torq v2.0.0 TBD TBD
SL2610 Moonshine Tiny Encoder (5 sec audio) Torq v2.0.0 TBD TBD

Deployment

Compiled Models

Torq compiled model files are provided in this repository. To recompile the models, see the Torq Documentation.

Source Models

The source model files are available at TBD.

Usage Tutorials / Example Apps

Example App GitHub Repositories

  • Moonshine Streaming Example (moonshine_streaming) in Torq Examples: Basic model usage examples for Torq

License

Both the source model and the compiled model for on-device deployment are licensed under MIT License.

Learn More