Text Ranking
sentence-transformers
Safetensors
Transformers
multilingual
t5gemma2
text2text-generation
reranker
encoder-decoder
FBNL
Retrieval
RAG
Yuki131 commited on
Commit
c34f103
·
verified ·
1 Parent(s): 74efa17

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -1
README.md CHANGED
@@ -44,10 +44,35 @@ We instantiate KaLM-Reranker-V1 in three sizes, `Nano`, `Small`, and `Large`, wi
44
  Extensive experiments on BEIR, MIRACL, and LMEB show that the KaLM-Reranker-V1 series achieves competitive reranking performance compared with strong industrial rerankers while significantly reducing online overhead.
45
 
46
  # Model Details
47
-
48
  | Models | Activated Params. | Non-Embedding Params. | Embedding Params. | #Layers | Sequence Length | Document Token Dim. | MEP Support | Instruction Aware |
49
  | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- |
50
  | [KaLM-Reranker-V1-Nano](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Nano) | 0.27B | 100M | 168M | 18 | 128K | 640 | 1x-32x | Yes |
51
  | [KaLM-Reranker-V1-Small](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Small) | 1B | 698M | 302M | 26 | 128K | 1152 | 1x-32x | Yes |
52
  | [KaLM-Reranker-V1-Large](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Large) | 4B | 3209M | 675M | 34 | 128K | 2560 | 1x-32x | Yes |
53
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
  Extensive experiments on BEIR, MIRACL, and LMEB show that the KaLM-Reranker-V1 series achieves competitive reranking performance compared with strong industrial rerankers while significantly reducing online overhead.
45
 
46
  # Model Details
 
47
  | Models | Activated Params. | Non-Embedding Params. | Embedding Params. | #Layers | Sequence Length | Document Token Dim. | MEP Support | Instruction Aware |
48
  | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- |
49
  | [KaLM-Reranker-V1-Nano](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Nano) | 0.27B | 100M | 168M | 18 | 128K | 640 | 1x-32x | Yes |
50
  | [KaLM-Reranker-V1-Small](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Small) | 1B | 698M | 302M | 26 | 128K | 1152 | 1x-32x | Yes |
51
  | [KaLM-Reranker-V1-Large](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Large) | 4B | 3209M | 675M | 34 | 128K | 2560 | 1x-32x | Yes |
52
 
53
+
54
+ # Prompt Template
55
+ ```python
56
+ f"<Document>: {document}"
57
+
58
+ ```
59
+ ```python
60
+ (
61
+ f"<bos><start_of_turn>user\n"
62
+ f"Judge whether the Document meets the requirements based on the Query and the Instruct provided. Note that the answer can only be \"yes\" or \"no\".\n\n"
63
+ f"<Instruct>: {task_instruction}\n"
64
+ f"<Query>: {query}<end_of_turn>\n"
65
+ f"<start_of_turn>model\n\n\n\n"
66
+ )
67
+
68
+ ```
69
+
70
+ # Evaluation
71
+ ## BEIR
72
+
73
+
74
+ ## MIRACL
75
+
76
+
77
+ ## LMEB
78
+