PEFT
Safetensors
lora
structured-generation
information-extraction

Qwen3.5-9B-oold-quantities-bf16-e2

A LoRA for schema-constrained quantity extraction, trained and measured by oold-llm-bench. The 9B under an explicit Qwen module list, not all-linear.

It is worth having in one condition. Where the prompt carries the class catalogue, every adapter measured so far scores below the model it was trained from. Where the prompt carries nothing and a grammar does the constraining, this is what it buys:

condition base this adapter
no-catalog-enforced 0.283 0.675 (n=112)
no-catalog-not-enforced 0.000 0.218 (n=120)
schema-prose-catalog-enforced 0.873 0.842 (n=120)
schema-prose-full-catalog-enforced 0.714 0.834 (n=119)

Recipe

base unsloth/Qwen3.5-9B
rank 16
target_modules the Qwen projection list
steps 1000
examples 1,000
corpus generated quantity documents, 100 classes, QUDT units
evaluated on Wiki-Measurements, held-out class half, human prose

Trained on machine prose and scored on human prose, deliberately: the register is held out so a score is not a report on the generator.

Serving

vLLM, loaded beside the base so the pair differs in the adapter and nothing else:

vllm serve unsloth/Qwen3.5-9B --enable-lora --lora-modules oold=OO-LD/Qwen3.5-9B-oold-quantities-bf16-e2 --max-lora-rank 16

--max-lora-rank has to be at least the rank, or the adapter loads and changes nothing. An adapter loaded at runtime through POST /v1/load_lora_adapter does not survive scale-to-zero.

What it does not do

The catalogue is worth more than the tune. Untuned with the class list in the prompt the same base reaches 0.873 on this task, above every adapter here, so this is a way to buy a short prompt and not a way to buy accuracy.

Across 4B to 32B in two families, parameter count orders neither the base score nor the gain. The numbers and the method are on the benchmark.

Downloads last month
21
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for OO-LD/oold-quantities-qwen9b-r16-e2-modulelist

Finetuned
Qwen/Qwen3.5-9B
Adapter
(114)
this model

Datasets used to train OO-LD/oold-quantities-qwen9b-r16-e2-modulelist