🏆 Evaluation Results

#2
by nathanael-fijalkow - opened
MVA+IASD LLM for code and proof org

Evaluation Results

Model: LLM-course/chess-player-v2
Parameters: 997,136 [PASS]
Chess library check: [PASS]

Performance

Metric Value
Total moves played 500
Games played 34
Legal moves (first try) 0 (0.0%)
Legal moves (with retries) 0 (0.0%)

Interpretation

  • >90% legal rate: Excellent! Model has learned chess rules well.
  • 70-90% legal rate: Good, but room for improvement.
  • <70% legal rate: Model struggles with legal move generation.

Sign up or log in to comment