🏆 Evaluation Results

#1
by nathanael-fijalkow - opened
MVA+IASD LLM for code and proof org

Evaluation Results

Model: LLM-course/supermodell
Parameters: 864,128 [PASS]
Chess library check: [PASS]

Performance

Metric Value
Total moves played 500
Games played 20
Legal moves (first try) 500 (100.0%)
Legal moves (with retries) 500 (100.0%)

Interpretation

  • >90% legal rate: Excellent! Model has learned chess rules well.
  • 70-90% legal rate: Good, but room for improvement.
  • <70% legal rate: Model struggles with legal move generation.

Sign up or log in to comment