Text Generation
Transformers
Safetensors
qwen3_5_text
prism
instruction-following
deterministic-compliance
sft
lora
conversational
Instructions to use TreeSoft/Prism-1-Pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TreeSoft/Prism-1-Pro with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="TreeSoft/Prism-1-Pro") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("TreeSoft/Prism-1-Pro") model = AutoModelForCausalLM.from_pretrained("TreeSoft/Prism-1-Pro", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use TreeSoft/Prism-1-Pro with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "TreeSoft/Prism-1-Pro" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TreeSoft/Prism-1-Pro", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/TreeSoft/Prism-1-Pro
- SGLang
How to use TreeSoft/Prism-1-Pro with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "TreeSoft/Prism-1-Pro" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TreeSoft/Prism-1-Pro", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "TreeSoft/Prism-1-Pro" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TreeSoft/Prism-1-Pro", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use TreeSoft/Prism-1-Pro with Docker Model Runner:
docker model run hf.co/TreeSoft/Prism-1-Pro
File size: 5,220 Bytes
2623243 e7692b1 2623243 f58684c 2623243 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 | ---
base_model: Qwen/Qwen3.5-4B
library_name: transformers
pipeline_tag: text-generation
tags:
- prism
- instruction-following
- deterministic-compliance
- sft
- lora
license: other
license_name: treesoft-open-source-license
---
# Prism 1 Pro

**Prism 1 Pro** is the flagship of the Prism 1 family β a set of
instruction-following language models tuned by **TreeSoft** for
**deterministic compliance**: reliably obeying the instructions it is given,
including instructions injected inline inside a prompt.
Pro is the top tier. It follows instructions the most reliably of the three
models, holding personas, tone, and hard constraints most consistently and
handling stacked, multi-part directives most cleanly. It improves on **Standard**
by a good margin, just as Standard clearly beats **Mini** β see *Model Family*
below. Choose Pro when compliance quality matters more than raw speed or
footprint.
## Model Details
### Model Description
Prism 1 Pro is a decoder-only causal language model fine-tuned (SFT with LoRA
via TRL) from a Qwen3.5-4B base. Training targets **instruction compliance**:
when the prompt contains a directive β a persona, a tone, a hard formatting
constraint, or a behavioral rule β the model should adopt it and hold it for the
whole response instead of drifting back to a default assistant voice.
The Prism tuning specifically hardens the model against inline instruction
injection, where a directive is embedded mid-prompt (for example, wrapped in
`<i>...</i>` markers) rather than placed in a system message. The intended
behavior is *deterministic*: the same instruction should produce the same class
of compliant behavior every time. Pro delivers this the most dependably in the
family.
- **Developed by:** TreeSoft
- **Model type:** Decoder-only causal language model (Qwen3.5 architecture)
- **Language(s):** Primarily English
- **License:** TreeSoft Open Source License
- **Finetuned from:** Qwen3.5-4B
### Model Family
| Model | Base | Approx. params | Position |
|-------|------|----------------|----------|
| Prism 1 Mini | Qwen3.5-0.8B | ~0.75B | Fastest, lightest |
| Prism 1 Standard | Qwen3.5-2B | ~1.9B | Balanced default β clearly beats Mini |
| **Prism 1 Pro** | Qwen3.5-4B | ~4.2B | Flagship β clearly beats Standard |
Each step up the family is meaningfully more capable than the one below it by a
good margin β better instruction adherence, steadier tone, and cleaner handling
of multi-part and hard-constraint instructions. Pro sits at the top: the most
reliable compliance in the range.
## Uses
### Direct Use
- Instruction- and persona-conditioned chat and generation
- Format-constrained generation (case, length, bullet-only, no-questions, etc.)
- Applications where dependable, repeatable instruction adherence is the priority
### Out-of-Scope Use
- High-stakes factual, medical, legal, or financial decisions without review
- Safety-critical automation with no human in the loop
## Bias, Risks, and Limitations
Prism 1 Pro inherits the biases and knowledge gaps of its base. Because it is
tuned to comply with injected instructions β and does so more effectively than
the smaller tiers β it will readily adopt personas or constraints supplied in
the prompt, including ones a downstream application may not intend. This makes
treating prompt-supplied instructions as untrusted input especially important in
multi-user or tool-connected settings: the stronger the compliance, the more
faithfully an injected directive is carried out.
### Recommendations
Keep a human in the loop for consequential outputs, validate format constraints
programmatically when they matter, and sanitize untrusted text that reaches the
prompt.
## How to Get Started
The easiest way to run Prism is through the official **Prism** repository:
**β https://github.com/treesoft-ai/prism**
It ships a ready-to-go CLI for chatting with the model, running one-shot
prompts, and everything else β just clone it, point it at Prism 1 Pro, and go.
Head over there to get started and run it locally.
## Training Details
### Training Data
Instruction-following data emphasizing compliance with directives β personas,
emotional tone, and hard behavioral/formatting constraints β including cases
where the directive is injected inline within the user prompt.
### Training Procedure
- **Method:** Supervised fine-tuning (SFT) with LoRA adapters via TRL, merged
into the released weights
- **Training regime:** bf16 mixed precision
## Technical Specifications
### Model Architecture
- Architecture: `Qwen3_5ForCausalLM` (hybrid linear + full attention, MTP head)
- Hidden size: 2560 Β· Layers: 32 Β· Attention heads: 16 (4 KV heads)
- Full-attention interval: every 4th layer
- Vocabulary: 248,320 Β· Max position embeddings: 262,144
- Precision: bfloat16 Β· Weights: ~8.4 GB (safetensors)
### Software
`torch>=2.3`, `transformers>=4.51.0`, `safetensors>=0.4.0`
## Citation
```bibtex
@misc{treesoft2026prism1pro,
title = {Prism 1 Pro},
author = {TreeSoft},
year = {2026}
}
```
## Model Card Contact
TreeSoft. Built on Qwen3.5. Licensed under the TreeSoft Open Source License.
|