Fetching metadata from the HF Docker repository...
-
Step 1: package scaffold, classifier, constraints, metric modules
devadit15 +1: Claude Fable 5 - schemas: EvalRequest/EvalReport contracts with is_proxy/requires_judge
honesty flags baked into the type layer
- classify: rule votes + bge prototype referee + instruction/source split
- constraints: IFEval-style extraction and deterministic checkers
- metrics: readability (Flesch/FK bands), lexical (MTLD, cliches, rhythm),
relevance (bge, per-paragraph drift), faithfulness (SummaC-ZS over
nli-deberta-v3-small), hallucination risk signals, static code ladder
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>