Spaces:
Sleeping
Sleeping
Hermes Bot commited on
feat: upgrade to google/gemma-2-9b-it
Browse files- 9B parameter model for better storytelling quality
- Still under 32B constraint
- 3-call generation: story + choices + health commentary
shared/inference_client.py
CHANGED
|
@@ -31,7 +31,7 @@ log = logging.getLogger("inference")
|
|
| 31 |
# The HF model id used for text generation (VibeThinker 1.5B, Gemma 4 12B, etc.)
|
| 32 |
INFERENCE_MODEL = os.environ.get(
|
| 33 |
"INFERENCE_MODEL",
|
| 34 |
-
"
|
| 35 |
)
|
| 36 |
|
| 37 |
# Provider: "hf-inference" (free serverless), "together", "fal-ai", "replicate"
|
|
|
|
| 31 |
# The HF model id used for text generation (VibeThinker 1.5B, Gemma 4 12B, etc.)
|
| 32 |
INFERENCE_MODEL = os.environ.get(
|
| 33 |
"INFERENCE_MODEL",
|
| 34 |
+
"google/gemma-2-9b-it", # 9B, newer, better storytelling
|
| 35 |
)
|
| 36 |
|
| 37 |
# Provider: "hf-inference" (free serverless), "together", "fal-ai", "replicate"
|