Update README.md

#1
by ArsVie - opened
Files changed (1) hide show
  1. README.md +12 -12
README.md CHANGED
@@ -11,6 +11,7 @@ license: apache-2.0
11
  short_description: An AI-driven visual novel β€” a small LLM writes every scene
12
  models:
13
  - google/gemma-4-12b-it
 
14
  - Abiray/Anima-base-v1.0-GGUF
15
  - circlestone-labs/Anima
16
  - Bingsu/adetailer
@@ -24,10 +25,18 @@ An AI-driven visual novel where every scene is written live by a **small
24
  LLM**. The model narrates, voices a three-character cast, swaps
25
  expressions and backgrounds, and offers branching choices β€” through a
26
  plain-text tool-call protocol (`[TOOL: set_expression …]`) that any small
27
- instruct model can speak. No fine-tune, no function-calling API.
 
 
28
 
29
  **Track:** Thousand Token Wood Β· **Hackathon:** Build Small
30
 
 
 
 
 
 
 
31
  ## How to play
32
 
33
  1. Press **Begin** on the title screen.
@@ -39,7 +48,7 @@ instruct model can speak. No fine-tune, no function-calling API.
39
 
40
  | Piece | On this Space (ZeroGPU) | At home |
41
  |---|---|---|
42
- | Scene writer | `google/gemma-4-12b-it` (bf16) via transformers, `@spaces.GPU` | Gemma 4 26B-A4B MoE Q4_K_M GGUF on stock llama.cpp with MTP speculative decoding, on an 8 GB GPU |
43
  | Character sprites | Live ComfyUI pipeline, **embedded in-process** under `@spaces.GPU`: face-gated base gen β†’ expression warping β†’ background removal | Same pipeline, ComfyUI as a subprocess over HTTP |
44
  | Backgrounds | Preset library + live txt2img for novel keys (same embedded pipeline) | Preset + live txt2img for novel scene keys |
45
 
@@ -55,13 +64,4 @@ are downloaded at startup. On an 8 GB card the LLM and the diffusion stack
55
  can't co-reside, so the home setup stops/relaunches servers around image
56
  bakes; on ZeroGPU none of that is needed β€” the GPU is granted per call.
57
  There's also a Docker variant (see `Dockerfile` on the repo) that runs
58
- the full 26B + live ComfyUI casting on a dedicated T4.
59
-
60
- ## Run it locally
61
-
62
- ```bash
63
- pip install -r requirements.txt gradio==6.16.0
64
- bash tools/start_gemma_server_stock.sh & # stock llama.cpp + MTP
65
- python app.py
66
- ARS_FABULA_BACKEND=mock python app.py # no model needed
67
- ```
 
11
  short_description: An AI-driven visual novel β€” a small LLM writes every scene
12
  models:
13
  - google/gemma-4-12b-it
14
+ - build-small-hackathon/Gemma-26B-A4B-VisualNovel-GGUF
15
  - Abiray/Anima-base-v1.0-GGUF
16
  - circlestone-labs/Anima
17
  - Bingsu/adetailer
 
25
  LLM**. The model narrates, voices a three-character cast, swaps
26
  expressions and backgrounds, and offers branching choices β€” through a
27
  plain-text tool-call protocol (`[TOOL: set_expression …]`) that any small
28
+ instruct model can speak β€” no function-calling API, and no fine-tune needed
29
+ to play (this hosted demo runs a stock instruct model). At home we go one
30
+ step further with a purpose-built fine-tune for sharper prose β€” see below.
31
 
32
  **Track:** Thousand Token Wood Β· **Hackathon:** Build Small
33
 
34
+ ## β–Ά Demo
35
+
36
+ [![Watch the demo](https://img.youtube.com/vi/0adUvKaqERM/maxresdefault.jpg)](https://www.youtube.com/watch?v=0adUvKaqERM)
37
+
38
+ Watch it on YouTube: https://www.youtube.com/watch?v=0adUvKaqERM
39
+
40
  ## How to play
41
 
42
  1. Press **Begin** on the title screen.
 
48
 
49
  | Piece | On this Space (ZeroGPU) | At home |
50
  |---|---|---|
51
+ | Scene writer | `google/gemma-4-12b-it` (bf16) via transformers, `@spaces.GPU` | Our **[Gemma 4 26B-A4B VN fine-tune](https://huggingface.co/build-small-hackathon/Gemma-26B-A4B-VisualNovel-GGUF)** β€” MoE, Q4_K_M GGUF on stock llama.cpp with MTP speculative decoding, on an 8 GB GPU |
52
  | Character sprites | Live ComfyUI pipeline, **embedded in-process** under `@spaces.GPU`: face-gated base gen β†’ expression warping β†’ background removal | Same pipeline, ComfyUI as a subprocess over HTTP |
53
  | Backgrounds | Preset library + live txt2img for novel keys (same embedded pipeline) | Preset + live txt2img for novel scene keys |
54
 
 
64
  can't co-reside, so the home setup stops/relaunches servers around image
65
  bakes; on ZeroGPU none of that is needed β€” the GPU is granted per call.
66
  There's also a Docker variant (see `Dockerfile` on the repo) that runs
67
+ the full 26B + live ComfyUI casting on a dedicated T4.