epic-quant / epic_quant /eval /__init__.py
toxzak's picture
Add eval package: local smoke test + Kaggle notebook for full eval sweep
47959ff
Raw
History Blame Contribute Delete
311 Bytes
"""EPIC-Quant quality evaluation package.
Two entrypoints:
- `smoke` — runs on CPU, validates the engine produces a sensible
forward end-to-end. Quick sanity check.
- `kaggle_notebook` — full eval sweep (WikiText PPL + MMLU Pro +
MRCR v2 8-needle 128K) intended to run on a Kaggle GPU box.
"""