tinyVoxtral-Realtime-for-testing

Random weights with the architecture and audio front-end of mistralai/Voxtral-Mini-4B-Realtime-2602: the encoder is shrunk to 3 layers and the text model to 2 layers, both of hidden size 64. The tokenizer keeps its 1000 special tokens and the first 3000 tokens of the normal vocab (all 256 bytes included). The mel bins, the sliding window, the downsample factor and the delay tokens are unchanged.

Built with make_tiny_voxtral_rt.py.

The output is not meaningful. Do not use this model for anything other than testing a loader or a runtime.

Downloads last month
115
GGUF
Model size
338k params
Architecture
mistral3
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ggml-org-dev/tinyVoxtral-Realtime-for-testing-gguf