| # Evaluation Guide | |
| This guide defines how to evaluate an LLM trained on the Glyphic Language. | |
| --- | |
| # 1. Syntax Tests | |
| Verify: | |
| - ordering rules | |
| - required roles | |
| - context ordering | |
| - single actor/action/object | |
| --- | |
| # 2. Reversibility Tests | |
| Check: | |
| encode(interpret(x)) == x | |
| for all valid sequences. | |
| --- | |
| # 3. Dictionary Consistency | |
| Ensure: | |
| - no hallucinated glyphs | |
| - no missing dictionary entries | |
| - correct role usage | |
| --- | |
| # 4. Scene Interpretation | |
| Test: | |
| - actor/action/object extraction | |
| - modifier interpretation | |
| - context layering | |
| --- | |
| # 5. Translation Accuracy | |
| Evaluate: | |
| - text → glyph | |
| - glyph → text | |
| - structured meaning → glyph | |
| - glyph → structured meaning | |
| --- | |
| # 6. Soulfile™ Compatibility | |
| Verify: | |
| - memory entries encode correctly | |
| - meaning compression works | |
| - continuity is preserved | |