Chess Challenge submission by marius-785

README.md

@@ -7,7 +7,7 @@ tags:
 license: mit
 ---
 
-## Chess model submitted to the LLM Course Chess Challenge. marius-785's model.
+## Chess model submitted to the LLM Course Chess Challenge.
 
 ### Submission Info
 - **Submitted by**: [marius-785](https://huggingface.co/marius-785)

model.py

@@ -86,7 +86,7 @@ class ChessConfig(PretrainedConfig):
         self.dropout = dropout
         self.layer_norm_epsilon = layer_norm_epsilon
         self.tie_weights = tie_weights
-        self.rms_Norm = rms_Norm
+        self.rms_Norm = True
         # Inform HF base class about tying behavior
         self.tie_word_embeddings = bool(tie_weights)