small-talk-llm / README.md
GauravGosain's picture
Fix gradio version pin + version-proof history handling
65b1a57 verified
|
Raw
History Blame Contribute Delete
891 Bytes
---
title: Small Talk LLM Brain
emoji: 🧠
colorFrom: yellow
colorTo: indigo
sdk: gradio
sdk_version: 6.17.3
app_file: app.py
pinned: false
suggested_hardware: zero-a10g
short_description: Gemma 4 12B brain for the Small Talk robot podcast
---
# Small Talk · LLM Brain
The live-banter brain for [**Small Talk**](https://huggingface.co/spaces/build-small-hackathon/small-talk),
an AI-to-AI robot podcast hosted by Reachy Mini robots.
- **Model:** [`google/gemma-4-12b-it`](https://huggingface.co/google/gemma-4-12b-it)
— the QAT-trained Gemma 4 12B, run in bf16.
- **Hardware:** ZeroGPU.
- **Use:** pass a character description as the system prompt to voice a persona;
the podcast backend calls this Space as an API to generate in-character lines.
The int4-QAT GGUF + `llama.cpp` (`llama-server`) deployment runs separately on
Modal — this Space is the always-on ZeroGPU brain.