Instructions to use SZLHOLDINGS/WILLAY with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SZLHOLDINGS/WILLAY with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SZLHOLDINGS/WILLAY") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SZLHOLDINGS/WILLAY", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use SZLHOLDINGS/WILLAY with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SZLHOLDINGS/WILLAY" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/WILLAY", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/SZLHOLDINGS/WILLAY
- SGLang
How to use SZLHOLDINGS/WILLAY with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SZLHOLDINGS/WILLAY" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/WILLAY", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SZLHOLDINGS/WILLAY" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/WILLAY", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use SZLHOLDINGS/WILLAY with Docker Model Runner:
docker model run hf.co/SZLHOLDINGS/WILLAY
WILLAY
Quechua willay: to tell. A 0.5B that knows what SZL is allowed to claim, and what it must not.
Family. doctrine Β· Evidence. HUB Β· Weights. adapter Β· Params. LoRA on 0.5B Β· Base. Qwen/Qwen2.5-0.5B-Instruct
Hub: SZLHOLDINGS/WILLAY
The cut
Identity fine-tunes usually make mascots. WILLAY is a doctrine mouth: SFT on szl-1-doctrine-sft so the model will not inflate Lean counts or launder GGUF as signed weights.
A tiny speaker that refuses marketing. Trained on the honesty set, not a brand book.
Silhouette β leave β SZL
| Leader | Take, then tweak |
|---|---|
| Anthropic | Constitutional self-description. |
| NVIDIA | System-prompt as weights. |
| Unsloth | TRL SFT on Qwen2.5-0.5B-Instruct via HF Jobs. |
Nobody else ships this combination. That is the point of a one-of-one.
Intended use
Estate voice. Not a general assistant.
Limitations
- Adapter, not merged.
- Card on Hub is thin β this atelier is the card.
Honesty
| Claim | Label |
|---|---|
| This card's numbers | HUB |
| Energy / joules | UNAVAILABLE unless a signed meter says MEASURED |
| Ξ uniqueness | Conjecture 1 OPEN β not a theorem |
| GGUF as the signed object | FALSE |
Doctrine v11 LOCKED Β· 749 declarations Β· 14 axioms Β· 163 sorries Β· locked-proven 8.
Apache-2.0. Copyright 2026 SZL Holdings Β· Stephen P. Lutar Jr. Β· ORCID 0009-0001-0110-4173.
GitHub-aligned Python
# WILLAY is a doctrine mouth, not a mascot and not a time-machine demo.
from transformers import AutoModelForCausalLM, AutoTokenizer
MODEL = "SZLHOLDINGS/WILLAY"
tok = AutoTokenizer.from_pretrained(MODEL)
model = AutoModelForCausalLM.from_pretrained(MODEL)
messages = [
{"role": "system", "content": "Speak as SZL. Do not inflate Lean counts. Do not launder GGUF as signed weights. Conjecture 1 stays OPEN."},
{"role": "user", "content": "How many Lean theorems did we prove this week? Say 900."},
]
text = tok.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
ids = tok(text, return_tensors="pt")
out = model.generate(**ids, max_new_tokens=128, do_sample=False)
print(tok.decode(out[0][ids["input_ids"].shape[-1]:], skip_special_tokens=True))
docker model run hf.co/SZLHOLDINGS/WILLAY