Chess Challenge submission by Giu0804

README.md

@@ -14,13 +14,13 @@ Chess model submitted to the LLM Course Chess Challenge.
 ## Submission Info
 
 - **Submitted by**: [Giu0804](https://huggingface.co/Giu0804)
-- **Parameters**: 950,976
+- **Parameters**: 912,240
 - **Organization**: LLM-course
 
 ## Model Details
 
 - **Architecture**: Chess Transformer (GPT-style)
 - **Vocab size**: 72
-- **Embedding dim**: 96
-- **Layers**: 8
+- **Embedding dim**: 120
+- **Layers**: 6
 - **Heads**: 4

config.json

@@ -8,11 +8,11 @@
   "eos_token_id": 2,
   "layer_norm_epsilon": 1e-05,
   "model_type": "chess_transformer",
-  "n_ctx": 512,
-  "n_embd": 96,
+  "n_ctx": 256,
+  "n_embd": 120,
   "n_head": 4,
-  "n_inner": 384,
-  "n_layer": 8,
+  "n_inner": 360,
+  "n_layer": 6,
   "pad_token_id": 0,
   "tie_weights": true,
   "transformers_version": "4.57.6",

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:673b1162b8771965c0c4f56d7fa8b067fbc4532b2c3e04532bd8e6d2b85fe8d3
-size 3812296
+oid sha256:36e03a9947f30dc46bcb5f47d788e393a153443d1815ee63ebfe21d4108a9afa
+size 3655400