Rusa-1-Small. Better Human.

Rusa-1-Small

Experimental CPU GGUFs for rewriting with a 350M-parameter model under 100 MB. These variants use ternary weights in most projections and Q2_K in selected tensors. The standard model is Rusa-1.

Build Size Download
Q6_K-distilled mixed ternary with learned block scales 99.03 MB TQ1_0-QAT
Original fitted ternary 94.12 MB TQ1_0-Fit-Down

Evaluation

The 99.03 MB build was selected after two consecutive rounds failed to improve the combined automated development score by two percentage points.

Automated rewrite check results for the early ternary, selected ternary, and Q6_K builds

On eight additional drafts, a blinded manual review gave the selected build credit for 10 of 24 factual relationships, compared with 19 of 24 for Q6_K. The selected build produced zero fully correct rewrites on those drafts. The automated checks missed some factual changes. For reliable rewriting, use the standard Rusa-1 GGUFs.

Inference

Use a CPU llama.cpp build with LFM2 and TQ1_0 support. Rusa uses a plain-text prompt. Put the draft after the rewrite instructions and end the prompt with two newlines, ### Rewritten:, and two more newlines. See the Rusa-1 prompt format for the full instructions.

llama-cli -m gguf/Rusa-1-Small-TQ1_0-QAT.gguf -ngl 0 --temp 0 -f prompt.txt
Downloads last month
6
GGUF
Model size
0.4B params
Architecture
lfm2
Hardware compatibility
Log In to add your hardware

1-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for jun-ai/Rusa-1-Small

Quantized
jun-ai/Rusa-1
Quantized
(1)
this model