Instructions to use OO-LD/oold-quantities-qwen9b-r16-e2-modulelist with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use OO-LD/oold-quantities-qwen9b-r16-e2-modulelist with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3.5-9B") model = PeftModel.from_pretrained(base_model, "OO-LD/oold-quantities-qwen9b-r16-e2-modulelist") - Notebooks
- Google Colab
- Kaggle
Qwen3.5-9B-oold-quantities-bf16-e2
A LoRA for schema-constrained quantity extraction, trained and measured by oold-llm-bench. The 9B under an explicit Qwen module list, not all-linear.
It is worth having in one condition. Where the prompt carries the class catalogue, every adapter measured so far scores below the model it was trained from. Where the prompt carries nothing and a grammar does the constraining, this is what it buys:
| condition | base | this adapter |
|---|---|---|
no-catalog-enforced |
0.283 | 0.675 (n=112) |
no-catalog-not-enforced |
0.000 | 0.218 (n=120) |
schema-prose-catalog-enforced |
0.873 | 0.842 (n=120) |
schema-prose-full-catalog-enforced |
0.714 | 0.834 (n=119) |
Recipe
| base | unsloth/Qwen3.5-9B |
| rank | 16 |
target_modules |
the Qwen projection list |
| steps | 1000 |
| examples | 1,000 |
| corpus | generated quantity documents, 100 classes, QUDT units |
| evaluated on | Wiki-Measurements, held-out class half, human prose |
Trained on machine prose and scored on human prose, deliberately: the register is held out so a score is not a report on the generator.
Serving
vLLM, loaded beside the base so the pair differs in the adapter and nothing else:
vllm serve unsloth/Qwen3.5-9B --enable-lora --lora-modules oold=OO-LD/Qwen3.5-9B-oold-quantities-bf16-e2 --max-lora-rank 16
--max-lora-rank has to be at least the rank, or the adapter loads and
changes nothing. An adapter loaded at runtime through
POST /v1/load_lora_adapter does not survive scale-to-zero.
What it does not do
The catalogue is worth more than the tune. Untuned with the class list in the prompt the same base reaches 0.873 on this task, above every adapter here, so this is a way to buy a short prompt and not a way to buy accuracy.
Across 4B to 32B in two families, parameter count orders neither the base score nor the gain. The numbers and the method are on the benchmark.
- Downloads last month
- 21