Update README.md

README.md

@@ -36,6 +36,16 @@ Computer Games by Mille Mei Zhen Loo & Gert Luzkov.
 
 ## Model architecture
 
+| **Component**                     | **Value**                               |
+|-----------------------------------|-----------------------------------------|
+| Context window size               | 256                                     |
+| Transformer layers                | 4                                       |
+| Attention heads                   | 1                                       |
+| Transformer feedforward dimension | 176                                     |
+| Loss function                     | Binary Cross Entropy (BCEWithLogitLoss) |
+| Optimiser                         | AdamW (learning rate = 10<sup>-4</sup>)            |
+| Scheduler                         | StepLR (gamma = 0.5, step size = 10)    |
+| Batch size                        | 128                                     |
 
 ## Data
 
@@ -44,6 +54,7 @@ The input data used for this model was the [Context_window_256](https://huggingf
 ## Model testing
 
 
+
 ## Recommendations for further usage