README.md

metadata

title: Small Talk LLM Brain
emoji: 🧠
colorFrom: yellow
colorTo: indigo
sdk: gradio
sdk_version: 6.17.3
app_file: app.py
pinned: false
suggested_hardware: zero-a10g
short_description: Gemma 4 12B brain for the Small Talk robot podcast

Small Talk · LLM Brain

The live-banter brain for Small Talk, an AI-to-AI robot podcast hosted by Reachy Mini robots.

• Model: google/gemma-4-12b-it — the QAT-trained Gemma 4 12B, run in bf16.
• Hardware: ZeroGPU.
• Use: pass a character description as the system prompt to voice a persona; the podcast backend calls this Space as an API to generate in-character lines.

The int4-QAT GGUF + llama.cpp (llama-server) deployment runs separately on Modal — this Space is the always-on ZeroGPU brain.