| --- |
| license: cc-by-nc-4.0 |
| base_model: Qwen/Qwen3.8-27B |
| tags: |
| - classification |
| - custom-code |
| - decision-model |
| --- |
| |
| # Lychee-27B |
|
|
| Lychee-27B is a decision model fine-tuned from Qwen3.8-27B. Given a state and typed questions (`choice`, `noul`, |
| `score`), it returns a probability for every option in one forward pass. |
|
|
| ## Results |
|
|
| | Decision Index 0.3 | Jev | Lychee-27B | |
| |---|---:|---:| |
| | Knowledge & Reasoning | **53.9** | 51.8 | |
| | Language Understanding | 59.2 | **66.2** | |
| | Retrieval & Classification | 55.4 | **63.9** | |
| | Tools & Automation | 75.1 | **80.8** | |
| | Arts & Human Taste | 39.1 | **47.0** | |
| | Public index | 58.0 | **62.8** | |
|
|
| Bold marks the better score in each row. Decision Index 0.3, public suite: Jev's figures are the board's, |
| Lychee-27B's were measured with the board's kit against the server in this repository. |
|
|
| ## Usage |
|
|
| Python 3.12 and one CUDA GPU with 80 GB (the bf16 weights take about 52 GB). |
|
|
| ```bash |
| pip install -r requirements.txt |
| python -m lychee.server --model . --port 8000 |
| ``` |
|
|
| The server answers `POST /v1/systemone` with |
| `{"state": ..., "questions": {name: {"type", "instructions", "criteria"}}}`. |
|
|
| In Python: |
|
|
| ```python |
| from lychee import Lychee |
| |
| model = Lychee(".") |
| answers, _ = model.decide( |
| "I was charged twice for the same order.", |
| {"team": {"type": "choice", "instructions": "Which team should take this?", |
| "criteria": {"billing": "Payments and refunds", "shipping": "Delivery problems", |
| "returns": "Sending items back"}}}, |
| ) |
| print(answers["team"]) # the chosen option and a probability for every option |
| ``` |
|
|
| A `noul` question gives the probability of yes; a `score` question takes its levels as a list, lowest first. Prompts |
| are read whole up to 262,144 tokens, the base model's context; longer ones, or ones that do not fit in the GPU's |
| memory, are refused, never truncated. |
|
|
| ## License |
|
|
| CC BY-NC 4.0 (`LICENSE`). Lychee-27B is fine-tuned from Qwen3.8-27B, which is licensed under the Apache License |
| 2.0 (`LICENSE.apache-2.0`); `NOTICE` lists the changes. |
|
|
