Fix example outputs, and add warning
Browse files
README.md
CHANGED
|
@@ -73,12 +73,13 @@ infer_w_vllm(model_path, query, instruction, documents)
|
|
| 73 |
```
|
| 74 |
|
| 75 |
**Expected Output:**
|
|
|
|
| 76 |
```
|
| 77 |
Query: What are the health benefits of exercise?
|
| 78 |
Instruction: Prioritize recent medical research
|
| 79 |
-
Score: 0.
|
| 80 |
-
Score:
|
| 81 |
-
Score:
|
| 82 |
```
|
| 83 |
|
| 84 |
### vLLM Usage
|
|
|
|
| 73 |
```
|
| 74 |
|
| 75 |
**Expected Output:**
|
| 76 |
+
> ⚠️ **Warning:** These scores are produced using the **BF16** model. If you run the same query with **NVFP4**, the scores may be slightly different.
|
| 77 |
```
|
| 78 |
Query: What are the health benefits of exercise?
|
| 79 |
Instruction: Prioritize recent medical research
|
| 80 |
+
Score: 0.8398 | Doc: A 2024 study shows exercise enhances cognitive function in older adults.
|
| 81 |
+
Score: -2.5469 | Doc: Regular exercise reduces risk of heart disease and improves mental health.
|
| 82 |
+
Score: -9.3750 | Doc: Ancient Greeks valued physical fitness for military training.
|
| 83 |
```
|
| 84 |
|
| 85 |
### vLLM Usage
|