How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf deepquillapp/trait-verifier:Q8_0
# Run inference directly in the terminal:
llama cli -hf deepquillapp/trait-verifier:Q8_0
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf deepquillapp/trait-verifier:Q8_0
# Run inference directly in the terminal:
llama cli -hf deepquillapp/trait-verifier:Q8_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf deepquillapp/trait-verifier:Q8_0
# Run inference directly in the terminal:
./build/bin/llama cli -hf deepquillapp/trait-verifier:Q8_0
Use Docker
docker model run hf.co/deepquillapp/trait-verifier:Q8_0
Quick Links

DeepQuill trait verifier

A fine-tune of Laya (ModernBERT-large encoder plus a typed-decision head). DeepQuill uses it to check character-trait claims that its local extractor pulls from fiction.

For each claim (a target character, field = value, the quote, and the passage), the model answers four yes/no questions:

  • aboutTarget: is it about that character?
  • lasting: a lasting attribute, not a momentary state?
  • literal: literal, not figurative?
  • asserted: asserted by the narration?

The claim is kept when all four pass.

Files

  • model.w8.onnx: weight-only 8-bit (MatMulNBits). Activations run in fp32, so a claim's result doesn't depend on what it's batched with.
  • tokenizer.json
  • verifier_config.json: the exact question texts, sequence limits and calibration temperature.

Training data

Everything the model was trained on is public:

  • 3,760 labelled claims from real extractor output over US-public-domain novels from 1894โ€“1930 (Project Gutenberg).
  • Synthetic contemporary passages written for this purpose.

The model was never trained on user manuscripts.

Evaluation

The model was scored on held-out sets that share no books or characters with the training data. Metric: keep-F1.

Test set This model Qwen3-4B LLM verifier No verifier
1920s public-domain claims (524) 0.75 0.32 0.45
Contemporary manuscript claims (157) 0.88 0.24 0.45
Downloads last month
14
GGUF
Model size
2B params
Architecture
qwen35
Hardware compatibility
Log In to add your hardware

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for deepquillapp/trait-verifier

Quantized
(94)
this model