ameforge commited on
Commit
c86e41c
·
verified ·
1 Parent(s): b648c64

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - embeddings
4
+ - retrieval
5
+ - tokenizer-free
6
+ - matryoshka
7
+ - onnx
8
+ ---
9
+ # AnankeEmbed-S (v1)
10
+
11
+ Tokenizer-free UTF-8 byte-level bidirectional embedding model (`d=384, layers=6, heads=6, patch=4, max_bytes=512, out_dim=256`, Matryoshka `[64, 128, 256]`).
12
+
13
+ - Best step: `38,000` (NVIDIA A100-SXM4-80GB, 6.71h)
14
+ - `MRR@64`: `0.7974` (`R@1`: `0.735`, `R@10`: `0.9155`)
15
+ - `MRR@256`: `0.7966` (`R@1`: `0.7335`, `R@10`: `0.9165`)
16
+ - Ananke Exam: `R@1 = 0.70`, `MRR = 0.791`