Update pipeline tag and add paper link

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +12 -10
README.md CHANGED
@@ -1,6 +1,13 @@
1
  ---
 
 
 
 
2
  language:
3
  - en
 
 
 
4
  tags:
5
  - ColBERT
6
  - PyLate
@@ -11,17 +18,12 @@ tags:
11
  - reasoning-retrieval
12
  - edge
13
  - loss:CachedContrastive
14
- base_model: mixedbread-ai/mxbai-edge-colbert-v0-32m
15
- datasets:
16
- - reasonir/reasonir-data
17
- - hanhainebula/bge-reasoner-data
18
- pipeline_tag: sentence-similarity
19
- library_name: PyLate
20
- license: cc-by-nc-4.0
21
  ---
22
 
23
  # SmallReason-ColBERT (32M)
24
 
 
 
25
  An ultra-small late-interaction retriever for **reasoning-intensive** retrieval.
26
  32M parameters, plus a **129-parameter query-side importance head**.
27
 
@@ -178,8 +180,8 @@ head is a no-op against the frozen base at step zero.
178
 
179
  Not soft-IDF. Across ~199K BRIGHT query tokens the gate–IDF Spearman correlation is
180
  **ρ = −0.02** — statistically detectable, practically zero. Per-split mean gate sits in
181
- 0.43–0.47 with std ≈ 0.10: the head is a soft re-weighting, not a selector. A fixed IDF
182
- gate on the same base reaches only 20.06, against 21.41 for the learned head.
183
 
184
  ---
185
 
@@ -240,4 +242,4 @@ the companion training/inference **code** is released under Apache-2.0 — but t
240
  Thanks to Antoine Chaffin (LightOn, Reason-ModernColBERT) for flagging the upstream
241
  `2_Dense/use_residual` config bug in `mxbai-edge-colbert-v0-32m` — the base weights were
242
  trained with a residual on that layer while the shipped config said otherwise. This
243
- model uses the patched config (`use_residual: true`).
 
1
  ---
2
+ base_model: mixedbread-ai/mxbai-edge-colbert-v0-32m
3
+ datasets:
4
+ - reasonir/reasonir-data
5
+ - hanhainebula/bge-reasoner-data
6
  language:
7
  - en
8
+ library_name: PyLate
9
+ license: cc-by-nc-4.0
10
+ pipeline_tag: text-retrieval
11
  tags:
12
  - ColBERT
13
  - PyLate
 
18
  - reasoning-retrieval
19
  - edge
20
  - loss:CachedContrastive
 
 
 
 
 
 
 
21
  ---
22
 
23
  # SmallReason-ColBERT (32M)
24
 
25
+ **Paper**: [SmallReason-ColBERT: An Ultra-Small Late-Interaction Retriever for Reasoning Intensive Retrieval](https://huggingface.co/papers/2609.29652)
26
+
27
  An ultra-small late-interaction retriever for **reasoning-intensive** retrieval.
28
  32M parameters, plus a **129-parameter query-side importance head**.
29
 
 
180
 
181
  Not soft-IDF. Across ~199K BRIGHT query tokens the gate–IDF Spearman correlation is
182
  **ρ = −0.02** — statistically detectable, practically zero. Per-split mean gate sits in
183
+ 0.43–0.47 with std ≈ 0.10: the head is a soft re-weighting, not a selector. A fixed
184
+ IDF gate on the same base reaches only 20.06, against 21.41 for the learned head.
185
 
186
  ---
187
 
 
242
  Thanks to Antoine Chaffin (LightOn, Reason-ModernColBERT) for flagging the upstream
243
  `2_Dense/use_residual` config bug in `mxbai-edge-colbert-v0-32m` — the base weights were
244
  trained with a residual on that layer while the shipped config said otherwise. This
245
+ model uses the patched config (`use_residual: true`).