Feature Extraction
PEFT
embeddings
text-classification
distillation
knowledge-distillation
generated-code
status:scaffold
Instructions to use Kodep/jev-topic-head with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Kodep/jev-topic-head with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
|
Download src/README.md from Kodep/jev-topic-head: direct link, hf CLI and curl.
- Browser
- Download file 1.23 kB
-
https://huggingface.co/Kodep/jev-topic-head/resolve/main/src/README.md
- Command line
-
hf download hf://Kodep/jev-topic-head/src/README.md
-
curl -L -o README.md https://huggingface.co/Kodep/jev-topic-head/resolve/main/src/README.md
1.23 kB
src/
The training + evaluation code. This is the primary thing we want to read — it's the only way to confirm what the Claude-written report actually did.
Files to push
| file | what it is |
|---|---|
train_head.py |
LoRA + prototype-head training |
evaluate.py |
metrics: top-1 accuracy, macro-F1, show/hide, confidence buckets |
rules_table.json |
the fixed step-4 show/hide rules (no AI) |
config.yaml |
all hyperparameters (see the checklist in the root README) |
Also include so it runs offline
requirements.txt(orenvironment.yml) — torch version, bf16 support,transformers/peftversions- a short how-to-run: base model path (
Qwen/Qwen3-Embedding-0.6B), seed flag, config flag, output paths - any preprocessing that turns a raw item into the model input (concatenation order, tokenization, max length)
What we'll check in train_head.py (vs the root README checklist)
LoRA rank/alpha/dropout + which modules · prototype head + cosine×scale + scale init 20 · prototype seeding from description embeddings · loss + label smoothing · the two AdamW groups + warmup/decay · early-stop on val macro-F1 · class-balanced sampling + hard-pair weighting · seed handling.