krishnateja95 commited on
Commit
ac471ce
·
verified ·
1 Parent(s): c2fa53d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -132,4 +132,16 @@ tokenizer.save_pretrained(SAVE_DIR)
132
 
133
  This model was evaluated on the well-known text benchmarks using [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness).
134
 
 
 
 
 
 
 
 
 
 
 
 
 
135
  ### Accuracy
 
132
 
133
  This model was evaluated on the well-known text benchmarks using [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness).
134
 
135
+ ```
136
+ lm_eval \
137
+ --model vllm \
138
+ --model_args pretrained="RedHatAI/sarvam-30b-FP8-Dynamic",dtype=auto,add_bos_token=True,max_model_len=16384,tensor_parallel_size=2,gpu_memory_utilization=0.8,enable_chunked_prefill=True,trust_remote_code=True \
139
+ --tasks openllm \
140
+ --write_out \
141
+ --batch_size auto \
142
+ --show_config
143
+ ```
144
+
145
+
146
+
147
  ### Accuracy