sheshansh-ctx commited on
Commit
a8f3049
·
verified ·
1 Parent(s): a5ca1ca

Fix example outputs, and add warning

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -73,12 +73,13 @@ infer_w_vllm(model_path, query, instruction, documents)
73
  ```
74
 
75
  **Expected Output:**
 
76
  ```
77
  Query: What are the health benefits of exercise?
78
  Instruction: Prioritize recent medical research
79
- Score: 0.8542 | Doc: A 2024 study shows exercise enhances cognitive function in older adults.
80
- Score: 0.7891 | Doc: Regular exercise reduces risk of heart disease and improves mental health.
81
- Score: 0.4123 | Doc: Ancient Greeks valued physical fitness for military training.
82
  ```
83
 
84
  ### vLLM Usage
 
73
  ```
74
 
75
  **Expected Output:**
76
+ > ⚠️ **Warning:** These scores are produced using the **BF16** model. If you run the same query with **NVFP4**, the scores may be slightly different.
77
  ```
78
  Query: What are the health benefits of exercise?
79
  Instruction: Prioritize recent medical research
80
+ Score: 0.8398 | Doc: A 2024 study shows exercise enhances cognitive function in older adults.
81
+ Score: -2.5469 | Doc: Regular exercise reduces risk of heart disease and improves mental health.
82
+ Score: -9.3750 | Doc: Ancient Greeks valued physical fitness for military training.
83
  ```
84
 
85
  ### vLLM Usage