| # S500 Baseline Record | |
| ## Run Identity | |
| - Name: frozen baseline38 GPT5.4 full10 | |
| - Date: 2026-05-25 | |
| - Local package: `tmcra_s500_baseline38_release_20260525` | |
| - Result archive: `results/lme_s500_frozen_baseline38_full10_20260525_results.tar.gz` | |
| - Judge output: `results/judge_gpt4o_alias_vectorengine.jsonl` | |
| - Summary: `results/judge_gpt4o_alias_vectorengine.jsonl.summary.json` | |
| ## Metrics | |
| - Evaluated samples: 500 | |
| - Correct: 310 | |
| - Accuracy: 62.00% | |
| - Judge alias: `gpt-4o` | |
| - Judge resolved model: `gpt-4o-2024-08-06` | |
| ## Subtask Metrics | |
| | subtask | accuracy | count | | |
| | --- | ---: | ---: | | |
| | knowledge-update | 70.51% | 78 | | |
| | multi-session | 39.85% | 133 | | |
| | single-session-assistant | 78.57% | 56 | | |
| | single-session-preference | 56.67% | 30 | | |
| | single-session-user | 81.43% | 70 | | |
| | temporal-reasoning | 63.16% | 133 | | |
| ## Interpretation | |
| This baseline is useful as a frozen comparison point. Stronger areas are single-session direct user facts, assistant detail recall, and knowledge-update. Weak areas remain multi-session aggregation, preference abstraction, and temporal reasoning. | |
| The full model output directory is included to preserve all runtime weights and training checkpoints, not only deployment weights. | |