🏆 Evaluation Results

#1
by nathanael-fijalkow - opened
MVA+IASD LLM for code and proof org

Evaluation Results

Model: LLM-course/chess_model_khg
Parameters: 871,808 [PASS]
Chess library check: [PASS]

Performance

Metric Value
Total moves played 500
Games played 23
Legal moves (first try) 422 (84.4%)
Legal moves (with retries) 475 (95.0%)

Interpretation

  • >90% legal rate: Excellent! Model has learned chess rules well.
  • 70-90% legal rate: Good, but room for improvement.
  • <70% legal rate: Model struggles with legal move generation.

Sign up or log in to comment