Valeriy Selitskiy commited on
Commit
e742e71
·
1 Parent(s): 1d8700e

Document 4096-token release defaults

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -27,9 +27,10 @@ llama.cpp WebAssembly/WebGPU.
27
  - **Bonsai 27B** — WebGPU-only hybrid model with strict adapter and full-graph
28
  checks; the UI refuses silent CPU fallback.
29
 
30
- The chat UI allocates a 4,000-token context and allows up to 2,000 completion
31
- tokens by default. Prompt text, system instructions, tool schemas, and prior
32
- turns share the same context window with the completion.
 
33
 
34
  The Space manifest pins
35
  [`WaveCut/Bonsai-web-GGUF`](https://huggingface.co/WaveCut/Bonsai-web-GGUF)
 
27
  - **Bonsai 27B** — WebGPU-only hybrid model with strict adapter and full-graph
28
  checks; the UI refuses silent CPU fallback.
29
 
30
+ The chat UI allocates a 4,096-token context and requests up to 4,096 completion
31
+ tokens by default. Prompt text, system instructions, tool schemas, prior turns,
32
+ and generated tokens share that same context window, so 4,096 is a completion
33
+ ceiling rather than a guarantee after a non-empty prompt.
34
 
35
  The Space manifest pins
36
  [`WaveCut/Bonsai-web-GGUF`](https://huggingface.co/WaveCut/Bonsai-web-GGUF)