What HilbertRaum is

HilbertRaum is an open-source desktop app (Windows, macOS, Linux; GPL-3.0-or-later) that runs open-weight GGUF models with llama.cpp entirely on your machine. It ships document Q&A with citations, evidence review, image understanding, Whisper transcription and dictation, offline translation for 51 languages, and an optional OpenAI-compatible loopback API for other programs on the same computer.

The whole workspace is portable and encrypted: app, models and data can live on a USB stick or an external SSD and move between machines.

How we pick models

The catalog is deliberately small. Every model is tested offline on real laptops for answer quality (a grounded question-answering set in German and English, scored without a cloud judge), decode speed and peak RAM, and the app recommends one model for your hardware so you never have to compare quants yourself. Weights are verified by SHA-256 before use.

Supporting models: Multilingual E5 Small (embeddings), BGE Reranker v2 M3, Whisper Small, Qwen2.5-VL 3B (vision), TranslateGemma 12B (translation, opt-in).

The full list with sizes, minimum RAM and licenses is in the verified model catalog and in the README on GitHub. The benchmark protocol and measured numbers are in docs/model-benchmarks.md.

What is coming here

• The grounded-QA evaluation set and benchmark results as datasets
• SHA-pinned copies of the catalog weights with our measurements in each model card

Questions and bug reports go to GitHub Issues.