GGUF
mirror
conversational
How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf RobinsAIWorld/kintsugi-models-frozen:
# Run inference directly in the terminal:
llama cli -hf RobinsAIWorld/kintsugi-models-frozen:
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf RobinsAIWorld/kintsugi-models-frozen:
# Run inference directly in the terminal:
llama cli -hf RobinsAIWorld/kintsugi-models-frozen:
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf RobinsAIWorld/kintsugi-models-frozen:
# Run inference directly in the terminal:
./llama-cli -hf RobinsAIWorld/kintsugi-models-frozen:
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf RobinsAIWorld/kintsugi-models-frozen:
# Run inference directly in the terminal:
./build/bin/llama-cli -hf RobinsAIWorld/kintsugi-models-frozen:
Use Docker
docker model run hf.co/RobinsAIWorld/kintsugi-models-frozen:
Quick Links

Kintsugi frozen model mirror

Frozen mirror of the on-device GGUF models used by Celestial Kintsugi Oracle (mba.robin.kintsugitarot). Files are byte-identical server-side copies of the upstream repos below (copied 2026-08-12); nothing here changes unless we change it. Model set sourced from AtomicBot-ai/atomic-chat-mobile-data models.json.

Upstream sources

File Upstream License
LFM2.5-1.2B-Thinking-Q4_K_M.gguf LiquidAI/LFM2.5-1.2B-Thinking-GGUF lfm1.0 (LFM Open License)
LFM2.5-2.6B-Q4_K_M.gguf LiquidAI/LFM2.5-2.6B-GGUF lfm1.0 (LFM Open License)
LFM2-700M-Q4_K_M.gguf LiquidAI/LFM2-700M-GGUF lfm1.0 (LFM Open License)
LFM2-350M-Q4_K_M.gguf / Q5_K_M LiquidAI/LFM2-350M-GGUF lfm1.0 (LFM Open License)
Q4_K_M/Qwen3.5-4B-*.gguf sinatras/qwen3.5-4b-split Apache-2.0
Qwen3.5-2B-Q4_K_M.gguf unsloth/Qwen3.5-2B-GGUF Apache-2.0
Qwen3.5-0.8B-Q4_K_M.gguf unsloth/Qwen3.5-0.8B-GGUF Apache-2.0
gemma-3-1b-it-Q4_K_M.gguf ggml-org/gemma-3-1b-it-GGUF gemma (Gemma license)
SmolLM3-Q4_K_M.gguf ggml-org/SmolLM3-3B-GGUF Apache-2.0
Bonsai-8B-Q1_0.gguf prism-ml/Bonsai-8B-gguf Apache-2.0
Ternary-Bonsai-8B-Q2_0.gguf prism-ml/Ternary-Bonsai-8B-gguf Apache-2.0

Each model remains under its upstream license; consult the upstream cards before reuse.

Downloads last month
-
GGUF
Model size
8B params
Architecture
qwen3
Hardware compatibility
Log In to add your hardware

1-bit

2-bit

4-bit

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support