Spaces:
Running
Running
Org card: full Matryoshka ladder
Browse files
README.md
CHANGED
|
@@ -51,7 +51,7 @@ base's input space; gated bottleneck adapters add in-layer capacity per
|
|
| 51 |
modality. Gates are mutually exclusive by input modality, so non-gated
|
| 52 |
modalities execute the base's exact computation. A single forward pass
|
| 53 |
yields nested Matryoshka embeddings truncatable to
|
| 54 |
-
{2048, 1024, 512, 256, 64} dimensions. Training runs in hours on a single
|
| 55 |
GPU; connectors and packs ship as small artifacts with the frozen towers
|
| 56 |
downloaded separately.
|
| 57 |
|
|
|
|
| 51 |
modality. Gates are mutually exclusive by input modality, so non-gated
|
| 52 |
modalities execute the base's exact computation. A single forward pass
|
| 53 |
yields nested Matryoshka embeddings truncatable to
|
| 54 |
+
{2048, 1536, 1024, 512, 256, 128, 64} dimensions. Training runs in hours on a single
|
| 55 |
GPU; connectors and packs ship as small artifacts with the frozen towers
|
| 56 |
downloaded separately.
|
| 57 |
|