amd
/

granite-4.0-h-small-fp8

granitemoehybrid

Model card Files Files and versions

Xiao-AMD commited on Jan 20

Commit

0920a78

·

verified ·

1 Parent(s): 5d80ba7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -46,7 +46,7 @@ The model was evaluated on GSM8K.
 **Scripts:**
 ```
-export MODEL_DIR=/workspace/ibm/granite-4.0-h-small-fp8
 export VLLM_USE_V1=1
 export VLLM_ROCM_USE_AITER=0
 export VLLM_V1_USE_PREFILL_DECODE_ATTENTION=0

 **Scripts:**
 ```
+export MODEL_DIR=granite-4.0-h-small-fp8
 export VLLM_USE_V1=1
 export VLLM_ROCM_USE_AITER=0
 export VLLM_V1_USE_PREFILL_DECODE_ATTENTION=0