exploratory/LIMITATIONS.md

Exploratory endpoint limitations

This adapter was selected for JSON parse validity, not answer correctness. Its one-time final test produced valid JSON for 12/12 examples and exact partition-plus-law answers for 3/12. Validation and final test each contain 12 examples, so their rates have high uncertainty.

The synthetic generator used only four law combinations and confounds the same-type sign, different-type sign, and exponent. Law accuracy from this artifact is not benchmark, G1, or G3 evidence. A confirmatory generator must randomize those components independently.

Step 50 was selected on validation data by maximizing exact accuracy, then maximizing parse rate, then minimizing teacher-forced loss. The final test was evaluated once after restoring step 50. The endpoint applies the same schema-derived grammar used in validation and final testing. Grammar validity does not establish correctness.