Update README.md
Browse files
README.md
CHANGED
|
@@ -132,4 +132,16 @@ tokenizer.save_pretrained(SAVE_DIR)
|
|
| 132 |
|
| 133 |
This model was evaluated on the well-known text benchmarks using [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness).
|
| 134 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 135 |
### Accuracy
|
|
|
|
| 132 |
|
| 133 |
This model was evaluated on the well-known text benchmarks using [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness).
|
| 134 |
|
| 135 |
+
```
|
| 136 |
+
lm_eval \
|
| 137 |
+
--model vllm \
|
| 138 |
+
--model_args pretrained="RedHatAI/sarvam-30b-FP8-Dynamic",dtype=auto,add_bos_token=True,max_model_len=16384,tensor_parallel_size=2,gpu_memory_utilization=0.8,enable_chunked_prefill=True,trust_remote_code=True \
|
| 139 |
+
--tasks openllm \
|
| 140 |
+
--write_out \
|
| 141 |
+
--batch_size auto \
|
| 142 |
+
--show_config
|
| 143 |
+
```
|
| 144 |
+
|
| 145 |
+
|
| 146 |
+
|
| 147 |
### Accuracy
|