Lychee-27B

Lychee-27B is a decision model fine-tuned from Qwen3.8-27B. Given a state and typed questions (choice, noul, score), it returns a probability for every option in one forward pass.

Results

Decision Index 0.3	Jev	Lychee-27B
Knowledge & Reasoning	53.9	51.8
Language Understanding	59.2	66.2
Retrieval & Classification	55.4	63.9
Tools & Automation	75.1	80.8
Arts & Human Taste	39.1	47.0
Public index	58.0	62.8

Bold marks the better score in each row. Decision Index 0.3, public suite: Jev's figures are the board's, Lychee-27B's were measured with the board's kit against the server in this repository.

Usage

Python 3.12 and one CUDA GPU with 80 GB (the bf16 weights take about 52 GB).

pip install -r requirements.txt
python -m lychee.server --model . --port 8000

The server answers POST /v1/systemone with {"state": ..., "questions": {name: {"type", "instructions", "criteria"}}}.

In Python:

from lychee import Lychee

model = Lychee(".")
answers, _ = model.decide(
    "I was charged twice for the same order.",
    {"team": {"type": "choice", "instructions": "Which team should take this?",
              "criteria": {"billing": "Payments and refunds", "shipping": "Delivery problems",
                           "returns": "Sending items back"}}},
)
print(answers["team"])  # the chosen option and a probability for every option

A noul question gives the probability of yes; a score question takes its levels as a list, lowest first. Prompts are read whole up to 262,144 tokens, the base model's context; longer ones, or ones that do not fit in the GPU's memory, are refused, never truncated.

License

CC BY-NC 4.0 (LICENSE). Lychee-27B is fine-tuned from Qwen3.8-27B, which is licensed under the Apache License 2.0 (LICENSE.apache-2.0); NOTICE lists the changes.