Update README.md

README.md

@@ -63,6 +63,8 @@ This is an **experimental research model** designed to explore hybrid architectu
 ## Training Details
 
 - **Training Context Window:** 4096 tokens
+- **Training GPU** AMD MI300X x 1(takes 68hrs)
+- **Training Strategy** 8bit MLP Quant, frozen emb,mlp,head, Deepspeed Stage1
 - **Base Model Initialization:** Weights initialized from Reka-flash3 21B
 - **Architecture Conversion:** Transformer attention blocks systematically replaced with RWKV blocks, except for 6 strategically placed GQA layers