Update README.md
#1
by ArsVie - opened
README.md
CHANGED
|
@@ -11,6 +11,7 @@ license: apache-2.0
|
|
| 11 |
short_description: An AI-driven visual novel β a small LLM writes every scene
|
| 12 |
models:
|
| 13 |
- google/gemma-4-12b-it
|
|
|
|
| 14 |
- Abiray/Anima-base-v1.0-GGUF
|
| 15 |
- circlestone-labs/Anima
|
| 16 |
- Bingsu/adetailer
|
|
@@ -24,10 +25,18 @@ An AI-driven visual novel where every scene is written live by a **small
|
|
| 24 |
LLM**. The model narrates, voices a three-character cast, swaps
|
| 25 |
expressions and backgrounds, and offers branching choices β through a
|
| 26 |
plain-text tool-call protocol (`[TOOL: set_expression β¦]`) that any small
|
| 27 |
-
instruct model can speak
|
|
|
|
|
|
|
| 28 |
|
| 29 |
**Track:** Thousand Token Wood Β· **Hackathon:** Build Small
|
| 30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
## How to play
|
| 32 |
|
| 33 |
1. Press **Begin** on the title screen.
|
|
@@ -39,7 +48,7 @@ instruct model can speak. No fine-tune, no function-calling API.
|
|
| 39 |
|
| 40 |
| Piece | On this Space (ZeroGPU) | At home |
|
| 41 |
|---|---|---|
|
| 42 |
-
| Scene writer | `google/gemma-4-12b-it` (bf16) via transformers, `@spaces.GPU` | Gemma 4 26B-A4B MoE Q4_K_M GGUF on stock llama.cpp with MTP speculative decoding, on an 8 GB GPU |
|
| 43 |
| Character sprites | Live ComfyUI pipeline, **embedded in-process** under `@spaces.GPU`: face-gated base gen β expression warping β background removal | Same pipeline, ComfyUI as a subprocess over HTTP |
|
| 44 |
| Backgrounds | Preset library + live txt2img for novel keys (same embedded pipeline) | Preset + live txt2img for novel scene keys |
|
| 45 |
|
|
@@ -55,13 +64,4 @@ are downloaded at startup. On an 8 GB card the LLM and the diffusion stack
|
|
| 55 |
can't co-reside, so the home setup stops/relaunches servers around image
|
| 56 |
bakes; on ZeroGPU none of that is needed β the GPU is granted per call.
|
| 57 |
There's also a Docker variant (see `Dockerfile` on the repo) that runs
|
| 58 |
-
the full 26B + live ComfyUI casting on a dedicated T4.
|
| 59 |
-
|
| 60 |
-
## Run it locally
|
| 61 |
-
|
| 62 |
-
```bash
|
| 63 |
-
pip install -r requirements.txt gradio==6.16.0
|
| 64 |
-
bash tools/start_gemma_server_stock.sh & # stock llama.cpp + MTP
|
| 65 |
-
python app.py
|
| 66 |
-
ARS_FABULA_BACKEND=mock python app.py # no model needed
|
| 67 |
-
```
|
|
|
|
| 11 |
short_description: An AI-driven visual novel β a small LLM writes every scene
|
| 12 |
models:
|
| 13 |
- google/gemma-4-12b-it
|
| 14 |
+
- build-small-hackathon/Gemma-26B-A4B-VisualNovel-GGUF
|
| 15 |
- Abiray/Anima-base-v1.0-GGUF
|
| 16 |
- circlestone-labs/Anima
|
| 17 |
- Bingsu/adetailer
|
|
|
|
| 25 |
LLM**. The model narrates, voices a three-character cast, swaps
|
| 26 |
expressions and backgrounds, and offers branching choices β through a
|
| 27 |
plain-text tool-call protocol (`[TOOL: set_expression β¦]`) that any small
|
| 28 |
+
instruct model can speak β no function-calling API, and no fine-tune needed
|
| 29 |
+
to play (this hosted demo runs a stock instruct model). At home we go one
|
| 30 |
+
step further with a purpose-built fine-tune for sharper prose β see below.
|
| 31 |
|
| 32 |
**Track:** Thousand Token Wood Β· **Hackathon:** Build Small
|
| 33 |
|
| 34 |
+
## βΆ Demo
|
| 35 |
+
|
| 36 |
+
[](https://www.youtube.com/watch?v=0adUvKaqERM)
|
| 37 |
+
|
| 38 |
+
Watch it on YouTube: https://www.youtube.com/watch?v=0adUvKaqERM
|
| 39 |
+
|
| 40 |
## How to play
|
| 41 |
|
| 42 |
1. Press **Begin** on the title screen.
|
|
|
|
| 48 |
|
| 49 |
| Piece | On this Space (ZeroGPU) | At home |
|
| 50 |
|---|---|---|
|
| 51 |
+
| Scene writer | `google/gemma-4-12b-it` (bf16) via transformers, `@spaces.GPU` | Our **[Gemma 4 26B-A4B VN fine-tune](https://huggingface.co/build-small-hackathon/Gemma-26B-A4B-VisualNovel-GGUF)** β MoE, Q4_K_M GGUF on stock llama.cpp with MTP speculative decoding, on an 8 GB GPU |
|
| 52 |
| Character sprites | Live ComfyUI pipeline, **embedded in-process** under `@spaces.GPU`: face-gated base gen β expression warping β background removal | Same pipeline, ComfyUI as a subprocess over HTTP |
|
| 53 |
| Backgrounds | Preset library + live txt2img for novel keys (same embedded pipeline) | Preset + live txt2img for novel scene keys |
|
| 54 |
|
|
|
|
| 64 |
can't co-reside, so the home setup stops/relaunches servers around image
|
| 65 |
bakes; on ZeroGPU none of that is needed β the GPU is granted per call.
|
| 66 |
There's also a Docker variant (see `Dockerfile` on the repo) that runs
|
| 67 |
+
the full 26B + live ComfyUI casting on a dedicated T4.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|