chiaraDG/gpt2-medium-chess-lora

GPT-2 Chess LoRA

A GPT-2 model fine-tuned on Lichess chess games to predict the best move given a board position in FEN format.

Training Data

• Dataset: Lichess/standard-chess-games
• Filtered to games where both players are rated > 2000 ELO
• 20000 games used for fine-tuning

Prompt Format

The model expects input in exactly this format:

Board FEN: <fen string>
Best move:

And will complete it with a UCI move like e2e4.

Training

• Base model: openai-community/gpt2-medium
• Fine-tuning method: LoRA (r=32, alpha=64)
• Max steps: 10000
• Learning rate: 5e-4
• Custom tokens added: all 64 board squares as atomic tokens (a1-h8)

Usage

This model is used as part of a TransformerPlayer chess agent that scores all legal moves by log-probability and selects the highest scoring one.