Update README.md
Browse files
README.md
CHANGED
|
@@ -120,6 +120,7 @@ batch = tokenizer(encoded_data, return_tensors='pt', padding=True).to('cuda')
|
|
| 120 |
outputs = model(**batch)
|
| 121 |
rewards = outputs[0].squeeze(-1).cpu().tolist()
|
| 122 |
print(rewards)
|
|
|
|
| 123 |
```
|
| 124 |
|
| 125 |
### Inference with lmdeploy
|
|
|
|
| 120 |
outputs = model(**batch)
|
| 121 |
rewards = outputs[0].squeeze(-1).cpu().tolist()
|
| 122 |
print(rewards)
|
| 123 |
+
# [-0.5702977776527405, -11.030370712280273] for previous example data
|
| 124 |
```
|
| 125 |
|
| 126 |
### Inference with lmdeploy
|