Beholder-q4f16 / README.md
GetBeholder's picture
v5: MIN short-prompt build (q4f16) + clean README
2d91503 verified
|
Raw
History Blame Contribute Delete
1.66 kB
---
license: other
license_name: polyform-noncommercial-1.0.0
license_link: https://polyformproject.org/licenses/noncommercial/1.0.0/
library_name: mlc-llm
pipeline_tag: text-generation
tags:
- beholder
- state-extraction
- roleplay
- webllm
- mlc
- q4f16
- webgpu
---
# Beholder β€” q4f16 (in-browser / WebLLM)
The **MLC `q4f16_1`** build of the **Beholder** state-extractor β€” runs **fully in the browser** on
WebGPU via [WebLLM](https://github.com/mlc-ai/web-llm), and against any OpenAI-compatible endpoint.
Beholder reads roleplay / narrative prose and emits structured character state β€” clothing, colors,
materials, held items, and wounds β€” per body slot, so a paperdoll panel can track what characters are
wearing and carrying without the roleplay model losing the thread.
The Beholder extension polls `version.json` and offers a one-click update when a newer build publishes here.
## Contents
- `params_shard_*.bin` + `tensor-cache*.json` β€” quantized 4-bit weights
- `Beholder-q4f16-webgpu.wasm` β€” compiled WebGPU model library (WebLLM `model_lib`)
- `mlc-chat-config.json` β€” runtime config (browser-right-sized context)
- `tokenizer.json` / `tokenizer_config.json`
- `version.json` β€” update manifest
## Notes
- 4-bit is the smallest, browser-friendly build (~430 MB). For higher fidelity on native runtimes,
use the 8-bit GGUF β†’ [GetBeholder/Beholder-GGUF](https://huggingface.co/GetBeholder/Beholder-GGUF).
- Use near-greedy decoding (low temperature) for stable structured output.
## License
[PolyForm Noncommercial 1.0.0](https://polyformproject.org/licenses/noncommercial/1.0.0/). Commercial use by permission.