metadata
title: Build Small
emoji: 🛠️
colorFrom: green
colorTo: gray
sdk: docker
app_port: 7860
pinned: false
Model weights
| Model | HF Hub Repo | GGUF File | Runtime | Params | Size | Role |
|---|---|---|---|---|---|---|
| MiniCPM5-1B Q8_0 | Abiray/MiniCPM5-1B-GGUF | minicpm5-1b-Q8_0.gguf |
llama-cpp-python | 1.08 B | ~1.1 GB | English text generation (Phase 1) |
| tiny-aya-water Q4_K_M | CohereLabs/tiny-aya-water-GGUF | tiny-aya-water-q4_k_m.gguf |
llama-cpp-python | 3.35 B | ~2.1 GB | Translation (active) |
| OmniVoice Q8_0 (base + tokenizer) | Serveurperso/OmniVoice-GGUF | omnivoice-base-Q8_0.gguf + omnivoice-tokenizer-Q8_0.gguf |
omnivoice.cpp | 0.6 B | ~950 MB | Text-to-speech |
| FLUX.2-klein 4B Q4_K_M | unsloth/FLUX.2-klein-4B-GGUF | flux-2-klein-4b-Q4_K_M.gguf |
diffusers | 4 B | ~2.6 GB | Image generation |
The demo works on my machine, two days to figure out how to deploy and still was stuck.