thehekimoghlu
/

QCOP

Image-Text-to-Text

vision-language

Mixture of Experts

Model card Files Files and versions

thehekimoghlu commited on Apr 21

Commit

059fac6

·

verified ·

1 Parent(s): 7d0b8b1

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ pipeline_tag: image-text-to-text
 |:---|:---|
 | **Total Parameters** | ~40B total, 5B active per token (MoE sparse activation) |
 | **Architecture** | Mixture-of-Experts Vision-Language Model (MoE VLM) |
-| **Experts** | 256 experts, 8 active per token |
 | **Context Length** | 396,488 tokens |
 | **Precision** | BF16 |
 | **Input** | Image (PNG, JPEG) + Text |

 |:---|:---|
 | **Total Parameters** | ~40B total, 5B active per token (MoE sparse activation) |
 | **Architecture** | Mixture-of-Experts Vision-Language Model (MoE VLM) |
+| **Experts** | 384 experts, 16 active per token |
 | **Context Length** | 396,488 tokens |
 | **Precision** | BF16 |
 | **Input** | Image (PNG, JPEG) + Text |