Qwen
/

Qwen3.5-0.8B-Base

Image-Text-to-Text

Model card Files Files and versions

hzhwcmhf commited on Mar 1

Commit

f753615

·

verified ·

1 Parent(s): 4dac375

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -49,7 +49,7 @@ For more details, please refer to our blog post [Qwen3.5](https://qwen.ai/blog?i
     - Hidden Dimension: 1024
     - Token Embedding: 248320 (Padded)
     - Number of Layers: 24
-    - Hidden Layout: 8 × (3 × (Gated DeltaNet → FFN) → 1 × (Gated Attention → FFN))
     - Gated DeltaNet:
         - Number of Linear Attention Heads: 16 for V and 16 for QK
         - Head Dimension: 128

     - Hidden Dimension: 1024
     - Token Embedding: 248320 (Padded)
     - Number of Layers: 24
+    - Hidden Layout: 6 × (3 × (Gated DeltaNet → FFN) → 1 × (Gated Attention → FFN))
     - Gated DeltaNet:
         - Number of Linear Attention Heads: 16 for V and 16 for QK
         - Head Dimension: 128