Hugging Face's logo

amd
/
DeepSeek-R1-0528-MXFP4

Safetensors
deepseek_v3
custom_code
8-bit precision
quark
Model card Files
xet
Community
3
linzhao-amd commited on
Commit
e182145
·
verified ·
1 Parent(s): cb4f49f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -100,7 +100,7 @@ The model was evaluated on AIME24, GPQA Diamond, and MATH-500 benchmarks using t
100
 
101
  ### Reproduction
102
 
103
- The results were obtained using the following commands, using custom tasks and 10 rounds under different random seeds.
104
 
105
  ```
106
  MODEL_ARGS="model_name=amd/DeepSeek-R1-0528-MXFP4-Preview,dtype=bfloat16,tensor_parallel_size=8,max_model_length=71536,max_num_batched_tokens=32768,gpu_memory_utilization=0.85,generation_parameters={max_new_tokens:65536,temperature:0.6,top_p:0.95,seed:$SEED}"
 
100
 
101
  ### Reproduction
102
 
103
+ The results were obtained using [vLLM](https://docs.vllm.ai/en/latest/) and [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) framworks. We took 10 rounds with different random seeds for reliable performance estimation.
104
 
105
  ```
106
  MODEL_ARGS="model_name=amd/DeepSeek-R1-0528-MXFP4-Preview,dtype=bfloat16,tensor_parallel_size=8,max_model_length=71536,max_num_batched_tokens=32768,gpu_memory_utilization=0.85,generation_parameters={max_new_tokens:65536,temperature:0.6,top_p:0.95,seed:$SEED}"