Update README.md
Browse files
README.md
CHANGED
|
@@ -86,7 +86,7 @@ The `RWKVReRanker` utilizes the final hidden state produced by the main `Embeddi
|
|
| 86 |
#### Workflow
|
| 87 |
1. **Format** Query and Document based on Online template.
|
| 88 |
2. Run the **Embedding Model** to generate the final State.
|
| 89 |
-
3. Feed the **
|
| 90 |
|
| 91 |
#### 📝 Online Mode Usage Example
|
| 92 |
|
|
@@ -132,7 +132,7 @@ for i in range(len(batch_tokens)):
|
|
| 132 |
_, state = emb_model.forward(batch_tokens, None)
|
| 133 |
|
| 134 |
# 6. Score with ReRanker
|
| 135 |
-
# The ReRanker expects the
|
| 136 |
# state[1] shape: [Layers, Batch, Heads, HeadSize, HeadSize]
|
| 137 |
logits = reranker.forward(state[1])
|
| 138 |
scores = torch.sigmoid(logits) # Convert logits to probabilities (0-1)
|
|
|
|
| 86 |
#### Workflow
|
| 87 |
1. **Format** Query and Document based on Online template.
|
| 88 |
2. Run the **Embedding Model** to generate the final State.
|
| 89 |
+
3. Feed the **TimeMixing State** (`state[1]`) into the **ReRanker** to get a relevance score.
|
| 90 |
|
| 91 |
#### 📝 Online Mode Usage Example
|
| 92 |
|
|
|
|
| 132 |
_, state = emb_model.forward(batch_tokens, None)
|
| 133 |
|
| 134 |
# 6. Score with ReRanker
|
| 135 |
+
# The ReRanker expects the TimeMixing State: state[1]
|
| 136 |
# state[1] shape: [Layers, Batch, Heads, HeadSize, HeadSize]
|
| 137 |
logits = reranker.forward(state[1])
|
| 138 |
scores = torch.sigmoid(logits) # Convert logits to probabilities (0-1)
|