File size: 2,945 Bytes
814e380 3d99255 814e380 1d59b28 9685fb8 d4a3ba3 9685fb8 1d59b28 6b5868d 3d99255 1d59b28 3d99255 1d59b28 3d99255 1d59b28 3d99255 1d59b28 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | ---
license: apache-2.0
base_model:
- mistralai/Voxtral-Mini-4B-Realtime-2602
---
## Real-time local transcription on a GGUF runtime path
> **Unofficial community GGUF conversion for real-time local transcription**
>
> Derived from [mistralai/Voxtral-Mini-4B-Realtime-2602](https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602) and integrated with [Openresearchtools-Engine](https://github.com/openresearchtools/engine).
| Item | Details |
| --- | --- |
| **Upstream model** | [mistralai/Voxtral-Mini-4B-Realtime-2602](https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602) |
| **Conversion source** | Derived from the upstream model and converted to GGUF for local runtime use |
| **Conversion script** | [convert_voxtral_to_gguf.py](https://github.com/openresearchtools/engine/blob/main/build/voxtral/convert_voxtral_to_gguf.py) |
| **License** | [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0) |
| | |
| **How to try it** | |
| **Desktop app example** | Try [Transcribe Offline](https://github.com/openresearchtools/transcribeoffline) to run live (streaming) or static (from audio files) transcriptions with optional diarization on Mac or Windows (Supports Cuda, Vulkan, Metal graphics acceleration or CPU runtime). |
| **Embeddable runtime** | Use [Openresearchtools-Engine](https://github.com/openresearchtools/engine) to integrate real-time local transcription into your own application. |
### Overview
This repository provides an unofficial GGUF conversion derived from [mistralai/Voxtral-Mini-4B-Realtime-2602](https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602), converted using [convert_voxtral_to_gguf.py](https://github.com/openresearchtools/engine/blob/main/build/voxtral/convert_voxtral_to_gguf.py) for real-time local transcription with [Openresearchtools-Engine](https://github.com/openresearchtools/engine).
The original model is released under [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0), and these converted weights are distributed under that same license.
### Disclaimer
> **This is a community conversion and example implementation maintained by [OpenResearchTools](https://openresearchtools.com).**
>
> It is **not affiliated with, endorsed by, or released by** the original model authors or upstream repository owners.
### Built for real-time local audio pipelines
- **Continuous-session transcription**
- **Live PCM / streaming-style input**
- **Embeddable local runtime integration**
### Related
**Need speaker-aware output?**
Pair this with [openresearchtools/diar_streaming_sortformer_4spk-v2.1-gguf](https://huggingface.co/openresearchtools/diar_streaming_sortformer_4spk-v2.1-gguf).
**Want to test it quickly?**
Try [Transcribe Offline](https://github.com/openresearchtools/transcribeoffline).
**Want to embed it directly?**
Use [Openresearchtools-Engine](https://github.com/openresearchtools/engine). |