Update README.md

README.md

@@ -0,0 +1,125 @@
+---
+language:
+- multilingual
+base_model:
+- google/t5gemma-2-1b-1b
+pipeline_tag: text-ranking
+datasets:
+- KaLM-Embedding/KaLM-embedding-finetuning-data
+- Shitao/bge-m3-data
+tags:
+- reranker
+- encoder-decoder
+- FBNL
+- Retrieval
+- RAG
+license: apache-2.0
+library_name: transformers
+---
+
+
+
+
+<h1 align="center">KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking</h1>
+
+
+<p align="center">
+  <a href="https://huggingface.co/collections/KaLM-Embedding/lychee-kalm-reranker">
+    <img src="https://img.shields.io/badge/%F0%9F%A4%97_Collection-Model-ffbd45.svg" alt="HF Collection">
+  </a>
+  <a href="https://arxiv.org/abs/2506.20923">
+    <img src="https://img.shields.io/badge/Paper-KaLM--Reranker--V1-d4333f?logo=arxiv&logoColor=white&colorA=cccccc&colorB=d4333f&style=flat" alt="Paper">
+  </a>
+  <a href="https://github.com/KaLM-Embedding">
+    <img src="https://img.shields.io/badge/GitHub-Code-blue.svg?logo=github&" alt="GitHub Code">
+  </a>
+</p>
+
+
+We present `KaLM-Reranker-V1`, a fast but not late-interaction (FBNL) reranker that decouples query and passage computation while retaining expressive relevance modeling. 
+
+Built on an encoder-decoder architecture, KaLM-Reranker-V1 uses the encoder to pre-encode passages with Matryoshka embedding pooling, while the decoder models the system instruction, user instruction, and query intent; cross-attention then captures relevance between the query context and passage representations. 
+This design makes KaLM-Reranker-V1 efficient through decoupled passage encoding, yet not late interaction, by preserving rich relevance modeling through cross-attention. 
+
+We instantiate KaLM-Reranker-V1 in three sizes, `Nano`, `Small`, and `Large`, with `0.27B`, `1B`, and `4B` activated parameters, respectively.
+
+
+![kalm-reranker-v1 architecture](./assets/framework.jpg)
+
+
+Extensive experiments on BEIR, MIRACL, and LMEB show that the KaLM-Reranker-V1 series achieves competitive reranking performance compared with strong industrial rerankers while significantly reducing online overhead.
+
+# Model Details
+| Models | Activated Params. | Non-Embedding Params. | Embedding Params. | #Layers | Sequence Length | Document Token Dim. | MEP Support | Instruction Aware |
+| ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- | ---- |
+| [KaLM-Reranker-V1-Nano](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Nano) | 0.27B | 100M | 168M | 18 | 128K | 640 | 1x-32x | Yes |
+| [KaLM-Reranker-V1-Small](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Small) | 1B | 698M | 302M | 26 | 128K | 1152 | 1x-32x | Yes |
+| [KaLM-Reranker-V1-Large](https://huggingface.co/KaLM-Embedding/KaLM-Reranker-V1-Large) | 4B | 3209M | 675M | 34 | 128K | 2560 | 1x-32x | Yes |
+
+
+# Prompt Template
+```python
+ f"<Document>: {document}"
+
+```
+```python
+(
+    f"<bos><start_of_turn>user\n"
+    f"Judge whether the Document meets the requirements based on the Query and the Instruct provided. Note that the answer can only be \"yes\" or \"no\".\n\n"
+    f"<Instruct>: {task_instruction}\n"
+    f"<Query>: {query}<end_of_turn>\n"
+    f"<start_of_turn>model\n\n\n\n"
+)
+
+```
+
+![kalm-reranker-v1 template](./assets/template.jpg)
+
+
+# Evaluation
+## BEIR
+On BEIR, KaLM-Reranker-V1 achieves state-of-the-art performance, on par with strong industrial models such as the Qwen3-Reranker series.
+![beir](./assets/beir.jpg)
+## MIRACL
+On MIRACL, despite not being extensively trained on multilingual data, KaLM-Reranker-V1 still shows excellent reranking performance.
+![miracl](./assets/miracl.jpg)
+## LMEB
+On LMEB, reranking models demonstrate a clear advantage, with even the 0.27B Nano model remaining competitive with 7–12B embedding models.
+![lmeb](./assets/lmeb.jpg)
+![lmeb_emb](./assets/lmeb_emb.jpg)
+
+# Usage
+
+
+# Citation
+If you find this model useful, please cite our papers.
+```
+@misc{zhao2026kalmreranker,
+      title={KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking},
+      author={Xinping Zhao and Jiaxin Xu and Ziqi Dai and Xin Zhang and Shouzheng Huang and Danyu Tang and Xinshuo Hu and Meishan Zhang and Baotian Hu and Min Zhang},
+      year={2026},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL},
+}
+
+@inproceedings{zhao2026kalmembeddingv2,
+      title={KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Model},
+      author={Xinping Zhao and Xinshuo Hu and Zifei Shan and Shouzheng Huang and Yao Zhou and Xin Zhang and Zetian Sun and Zhenyu Liu and Dongfang Li and Xinyuan Wei and Youcheng Pan and Yang Xiang and Meishan Zhang and Haofen Wang and Jun Yu and Baotian Hu and Min Zhang},
+      booktitle={The Fourteenth International Conference on Learning Representations},
+      year={2026},
+      url={https://openreview.net/forum?id=Y7qzhvWhcz}
+}
+
+@misc{hu2025kalmembedding,
+      title={KaLM-Embedding: Superior Training Data Brings A Stronger Embedding Model}, 
+      author={Xinshuo Hu and Zifei Shan and Xinping Zhao and Zetian Sun and Zhenyu Liu and Dongfang Li and Shaolin Ye and Xinyuan Wei and Qian Chen and Baotian Hu and Haofen Wang and Jun Yu and Min Zhang},
+      year={2025},
+      eprint={2501.01028},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL},
+      url={https://arxiv.org/abs/2501.01028}, 
+}
+```
+
+## Contact
+If you encounter any issues, feel free to contact us via the email: <zhaoxinping@stu.hit.edu.cn>