metadata
license: apache-2.0
OpenMOSE/HRWKV7-Reka-Flash3-Preview
This is experimental model.
BaseModel: Reka-Flash3 21B
Architecture: Modified RWKV hxa079 (x070 based) + No Position Embedding GQA
Training ctx:4096
Suitable ctx: 32768