Update README.md

README.md

@@ -1,5 +1,15 @@
 ---
 license: cc0-1.0
+datasets:
+- HuggingFaceFW/fineweb-edu
+tags:
+- MoE
+- VDront
+- AI
+- LMM
+- LM
+- 200m
+- 100m
 ---
 ![](img/pre.png)
 
@@ -28,5 +38,4 @@ VDrontV3 is a transformer-based architecture that implements a hybrid Mixture of
 
     Base Block: After the expert block, the hidden states pass through a shared, fixed "Base Block" (green box) consisting of standard transformer layers. This provides a common foundation for all routing paths.
 
-    Output Block & Mode Block: The final layers form an "Output Block" (also multi-version) that feeds into the LM head. Crucially, the architecture includes a "ModeBlock" (yellow box), which suggests the model can switch between different inference modes by selecting different versions of the output block.
-
+    Output Block & Mode Block: The final layers form an "Output Block" (also multi-version) that feeds into the LM head. Crucially, the architecture includes a "ModeBlock" (yellow box), which suggests the model can switch between different inference modes by selecting different versions of the output block.