linzhao-amd commited on
Commit
6399f2b
·
verified ·
1 Parent(s): 99838bb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -111,7 +111,7 @@ The model was evaluated on AIME24, GPQA Diamond, MATH-500, and GSM8K benchmarks.
111
 
112
  ### Reproduction
113
 
114
- The results of AIME24, MATH-500 and GPQA Diamond were obtained using [lighteval](https://github.com/huggingface/lighteval/tree/v0.10.0) and [vLLM](https://docs.vllm.ai/en/latest/), running with docker `rocm/vllm-private:pytorch-vllm-gfx950-mxfp4-mxfp6-v3`.
115
 
116
  ```
117
  MODEL_ARGS="model_name=amd/DeepSeek-R1-0528-MXFP4-ASQ,dtype=bfloat16,tensor_parallel_size=8,max_model_length=71536,max_num_batched_tokens=32768,gpu_memory_utilization=0.85,generation_parameters={max_new_tokens:65536,temperature:0.6,top_p:0.95,seed:$SEED}"
@@ -128,7 +128,7 @@ for i in $(seq 1 10); do
128
  2>&1 | tee -a "$LOG"
129
  ```
130
 
131
- The result of GSM8K was obtained using [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness) and [SGLang](https://docs.sglang.ai/), running with this [docker](https://hub.docker.com/layers/lmsysorg/sglang/v0.5.3.post3-rocm700-mi35x-srt/images/sha256-8c7281fcd4adc7942c7e674d464fee322d1775d7b546596ab4cc7edd258517fc).
132
 
133
  ```
134
  # Launching server
 
111
 
112
  ### Reproduction
113
 
114
+ The results of AIME24, MATH-500 and GPQA Diamond were obtained using [lighteval](https://github.com/huggingface/lighteval/tree/v0.10.0) and [vLLM](https://docs.vllm.ai/en/latest/), executed in the docker `rocm/vllm-private:pytorch-vllm-gfx950-mxfp4-mxfp6-v3`.
115
 
116
  ```
117
  MODEL_ARGS="model_name=amd/DeepSeek-R1-0528-MXFP4-ASQ,dtype=bfloat16,tensor_parallel_size=8,max_model_length=71536,max_num_batched_tokens=32768,gpu_memory_utilization=0.85,generation_parameters={max_new_tokens:65536,temperature:0.6,top_p:0.95,seed:$SEED}"
 
128
  2>&1 | tee -a "$LOG"
129
  ```
130
 
131
+ The result of GSM8K was obtained using [lm-eval-harness](https://github.com/EleutherAI/lm-evaluation-harness) and [SGLang](https://docs.sglang.ai/), executed in the [docker](https://hub.docker.com/layers/lmsysorg/sglang/v0.5.3.post3-rocm700-mi35x-srt/images/sha256-8c7281fcd4adc7942c7e674d464fee322d1775d7b546596ab4cc7edd258517fc).
132
 
133
  ```
134
  # Launching server