Spaces:
Running
Running
Valeriy Selitskiy commited on
Commit ·
e742e71
1
Parent(s): 1d8700e
Document 4096-token release defaults
Browse files
README.md
CHANGED
|
@@ -27,9 +27,10 @@ llama.cpp WebAssembly/WebGPU.
|
|
| 27 |
- **Bonsai 27B** — WebGPU-only hybrid model with strict adapter and full-graph
|
| 28 |
checks; the UI refuses silent CPU fallback.
|
| 29 |
|
| 30 |
-
The chat UI allocates a 4,
|
| 31 |
-
tokens by default. Prompt text, system instructions, tool schemas,
|
| 32 |
-
|
|
|
|
| 33 |
|
| 34 |
The Space manifest pins
|
| 35 |
[`WaveCut/Bonsai-web-GGUF`](https://huggingface.co/WaveCut/Bonsai-web-GGUF)
|
|
|
|
| 27 |
- **Bonsai 27B** — WebGPU-only hybrid model with strict adapter and full-graph
|
| 28 |
checks; the UI refuses silent CPU fallback.
|
| 29 |
|
| 30 |
+
The chat UI allocates a 4,096-token context and requests up to 4,096 completion
|
| 31 |
+
tokens by default. Prompt text, system instructions, tool schemas, prior turns,
|
| 32 |
+
and generated tokens share that same context window, so 4,096 is a completion
|
| 33 |
+
ceiling rather than a guarantee after a non-empty prompt.
|
| 34 |
|
| 35 |
The Space manifest pins
|
| 36 |
[`WaveCut/Bonsai-web-GGUF`](https://huggingface.co/WaveCut/Bonsai-web-GGUF)
|