jev-topic-head / src /README.md
Kodep's picture
scaffold: structure + READMEs + baseline report (code/data/checkpoints pending)
4e75514 verified
|
Raw History Blame Contribute Delete
1.23 kB

src/

The training + evaluation code. This is the primary thing we want to read — it's the only way to confirm what the Claude-written report actually did.

Files to push

file what it is
train_head.py LoRA + prototype-head training
evaluate.py metrics: top-1 accuracy, macro-F1, show/hide, confidence buckets
rules_table.json the fixed step-4 show/hide rules (no AI)
config.yaml all hyperparameters (see the checklist in the root README)

Also include so it runs offline

  • requirements.txt (or environment.yml) — torch version, bf16 support, transformers/peft versions
  • a short how-to-run: base model path (Qwen/Qwen3-Embedding-0.6B), seed flag, config flag, output paths
  • any preprocessing that turns a raw item into the model input (concatenation order, tokenization, max length)

What we'll check in train_head.py (vs the root README checklist)

LoRA rank/alpha/dropout + which modules · prototype head + cosine×scale + scale init 20 · prototype seeding from description embeddings · loss + label smoothing · the two AdamW groups + warmup/decay · early-stop on val macro-F1 · class-balanced sampling + hard-pair weighting · seed handling.