ccr-platform / evals /README.md
devaanand's picture
feat: upload tiers with placeholder sign-in, project archive/delete, no-em-dash rule
e7712a6
|
Raw
History Blame Contribute Delete
731 Bytes

Golden evals

Purpose: catch silent research-behavior drift - output shape, column names/order, metadata fields, warning codes - per design doc §16.

  • golden_datasets/ - frozen input corpora (never edit rows in place; add new files).
  • expected_outputs/ - human-approved expected results. Protected by a PreToolUse hook: Claude Code cannot edit files here. To update after an approved behavior change, regenerate manually and review the diff yourself before committing.
  • Runner arrives with spec 0005 (engine extraction freezes behavior first). Until then, the backend test suite's export-shape tests are the drift guard.

Rule of thumb: if a golden diff surprises you, the code is wrong until proven otherwise.