license: cc-by-nc-4.0
base_model: Qwen/Qwen3.8-27B
tags:
- classification
- custom-code
- decision-model
Lychee-27B
Lychee-27B is a decision model fine-tuned from Qwen3.8-27B. Given a state and typed questions (choice, noul,
score), it returns a probability for every option in one forward pass.
Results
| Decision Index 0.3 | Jev | Lychee-27B |
|---|---|---|
| Knowledge & Reasoning | 53.9 | 51.8 |
| Language Understanding | 59.2 | 66.2 |
| Retrieval & Classification | 55.4 | 63.9 |
| Tools & Automation | 75.1 | 80.8 |
| Arts & Human Taste | 39.1 | 47.0 |
| Public index | 58.0 | 62.8 |
Bold marks the better score in each row. Decision Index 0.3, public suite: Jev's figures are the board's, Lychee-27B's were measured with the board's kit against the server in this repository.
Usage
Python 3.12 and one CUDA GPU with 80 GB (the bf16 weights take about 52 GB).
pip install -r requirements.txt
python -m lychee.server --model . --port 8000
The server answers POST /v1/systemone with
{"state": ..., "questions": {name: {"type", "instructions", "criteria"}}}.
In Python:
from lychee import Lychee
model = Lychee(".")
answers, _ = model.decide(
"I was charged twice for the same order.",
{"team": {"type": "choice", "instructions": "Which team should take this?",
"criteria": {"billing": "Payments and refunds", "shipping": "Delivery problems",
"returns": "Sending items back"}}},
)
print(answers["team"]) # the chosen option and a probability for every option
A noul question gives the probability of yes; a score question takes its levels as a list, lowest first. Prompts
are read whole up to 262,144 tokens, the base model's context; longer ones, or ones that do not fit in the GPU's
memory, are refused, never truncated.
License
CC BY-NC 4.0 (LICENSE). Lychee-27B is fine-tuned from Qwen3.8-27B, which is licensed under the Apache License
2.0 (LICENSE.apache-2.0); NOTICE lists the changes.