MishaGGG commited on
Commit
cef1ccd
·
verified ·
1 Parent(s): dddbefa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ The model has two modes: "Base" and "Quality." In "Base" mode, responses are sho
20
 
21
  *Base model VDrontV2-0.1b*
22
 
23
- VDrontV3 / MeB-LM (Many Expert Block LM) is a transformer-based architecture that implements a hybrid Mixture of Experts (MoE) design with two specialized expert blocks.
24
 
25
  Embedding & Routing: The input passes through standard token and position embeddings. A "Router top-1" (a linear layer) processes the embedding to select a single expert (top-1 routing).
26
 
 
20
 
21
  *Base model VDrontV2-0.1b*
22
 
23
+ VDrontV3 is a transformer-based architecture that implements a hybrid Mixture of Experts (MoE) design with two specialized expert blocks.
24
 
25
  Embedding & Routing: The input passes through standard token and position embeddings. A "Router top-1" (a linear layer) processes the embedding to select a single expert (top-1 routing).
26