OpenMOSE
/

HRWKV7-Reka-Flash3-Preview

Text Generation

linear-attention

knowledge-distillation

Model card Files Files and versions

OpenMOSE commited on Jul 6, 2025

Commit

5dcceb7

·

verified ·

1 Parent(s): e37f8bd

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ HRWKV7-Reka-Flash3-Preview is an experimental hybrid architecture model that com
   - 6 GQA layers (No Rope, No Position Embeddings)
 - **Hidden Dimension:** 6144
 - **Training Context Window:** 4096 tokens
-- **Inference Context Window** 32768
 - **Training Strategy** Following RADLADS method based knowledge distillation
 ## Technical Innovation

   - 6 GQA layers (No Rope, No Position Embeddings)
 - **Hidden Dimension:** 6144
 - **Training Context Window:** 4096 tokens
+- **Inference Context Window** 32768+
 - **Training Strategy** Following RADLADS method based knowledge distillation
 ## Technical Innovation