File size: 915 Bytes
51adac7 | 1 2 3 4 5 6 7 8 | ## Exploratory endpoint limitations
This adapter was selected for JSON parse validity, not answer correctness. Its one-time final test produced valid JSON for 12/12 examples and exact partition-plus-law answers for 3/12. Validation and final test each contain 12 examples, so their rates have high uncertainty.
The synthetic generator used only four law combinations and confounds the same-type sign, different-type sign, and exponent. Law accuracy from this artifact is not benchmark, G1, or G3 evidence. A confirmatory generator must randomize those components independently.
Step 50 was selected on validation data by maximizing exact accuracy, then maximizing parse rate, then minimizing teacher-forced loss. The final test was evaluated once after restoring step 50. The endpoint applies the same schema-derived grammar used in validation and final testing. Grammar validity does not establish correctness.
|