Hugging Face's logo

mattbitzesty
/
pino-source-code

Model card Files
xet
 Community
pino-source-code / data /benchmarks /substitution_triplets /report.md
Matthew Ford
feat: expand substitution-triplet benchmark 8 -> 20
e6d699c
preview code
|
Raw
History Blame Contribute Delete
354 Bytes

Discordant substitution triplets

Status: complete. Admitted 20 triplets.

Skipped: {'no_identity': 60, 'no_distractor': 3}.

Each triplet encodes a supplier-attested perceptual preference whose structurally-closest alternative disagrees — the case where Morgan-style structural ranking fails and perceptual representations (POM) should win.