---
license: apache-2.0
base_model:
- mistralai/Voxtral-Mini-4B-Realtime-2602
---
## Real-time local transcription on a GGUF runtime path

> **Unofficial community GGUF conversion for real-time local transcription**
>
> Derived from [mistralai/Voxtral-Mini-4B-Realtime-2602](https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602) and integrated with [Openresearchtools-Engine](https://github.com/openresearchtools/engine).


| Item | Details |
| --- | --- |
| **Upstream model** | [mistralai/Voxtral-Mini-4B-Realtime-2602](https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602) |
| **Conversion source** | Derived from the upstream model and converted to GGUF for local runtime use |
| **Conversion script** | [convert_voxtral_to_gguf.py](https://github.com/openresearchtools/engine/blob/main/build/voxtral/convert_voxtral_to_gguf.py) |
| **License** | [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0) |
|   |   |
| **How to try it** |   |
| **Desktop app example** | Try [Transcribe Offline](https://github.com/openresearchtools/transcribeoffline) to run live (streaming) or static (from audio files) transcriptions with optional diarization on Mac or Windows (Supports Cuda, Vulkan, Metal graphics acceleration or CPU runtime). |
| **Embeddable runtime** | Use [Openresearchtools-Engine](https://github.com/openresearchtools/engine) to integrate real-time local transcription into your own application. |


### Overview

This repository provides an unofficial GGUF conversion derived from [mistralai/Voxtral-Mini-4B-Realtime-2602](https://huggingface.co/mistralai/Voxtral-Mini-4B-Realtime-2602), converted using [convert_voxtral_to_gguf.py](https://github.com/openresearchtools/engine/blob/main/build/voxtral/convert_voxtral_to_gguf.py) for real-time local transcription with [Openresearchtools-Engine](https://github.com/openresearchtools/engine).

The original model is released under [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0), and these converted weights are distributed under that same license.


### Disclaimer

> **This is a community conversion and example implementation maintained by [OpenResearchTools](https://openresearchtools.com).**
>
> It is **not affiliated with, endorsed by, or released by** the original model authors or upstream repository owners.


### Built for real-time local audio pipelines

- **Continuous-session transcription**
- **Live PCM / streaming-style input**
- **Embeddable local runtime integration**

### Related

**Need speaker-aware output?**  
Pair this with [openresearchtools/diar_streaming_sortformer_4spk-v2.1-gguf](https://huggingface.co/openresearchtools/diar_streaming_sortformer_4spk-v2.1-gguf).

**Want to test it quickly?**  
Try [Transcribe Offline](https://github.com/openresearchtools/transcribeoffline).

**Want to embed it directly?**  
Use [Openresearchtools-Engine](https://github.com/openresearchtools/engine).