kvaishnavi commited on
Commit
bdab679
·
verified ·
1 Parent(s): 79375d4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -35,8 +35,8 @@ huggingface-cli download microsoft/phi-4-onnx --include cpu_and_mobile/cpu-int4-
35
  pip install --pre onnxruntime-genai
36
 
37
  # Please adjust the model directory (-m) accordingly
38
- curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi3-qa.py -o phi3-qa.py
39
- python phi3-qa.py -m cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4 -e cpu
40
  ```
41
 
42
  For CUDA:
@@ -49,8 +49,8 @@ huggingface-cli download microsoft/phi-4-onnx --include gpu/* --local-dir .
49
  pip install --pre onnxruntime-genai-cuda
50
 
51
  # Please adjust the model directory (-m) accordingly
52
- curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi3-qa.py -o phi3-qa.py
53
- python phi3-qa.py -m gpu/gpu-int4-rtn-block-32 -e cuda
54
  ```
55
 
56
  For DirectML:
@@ -63,8 +63,8 @@ huggingface-cli download microsoft/phi-4-onnx --include gpu/* --local-dir .
63
  onnxruntime-genai-directml
64
 
65
  # Please adjust the model directory (-m) accordingly
66
- curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi3-qa.py -o phi3-qa.py
67
- python phi3-qa.py -m gpu/gpu-int4-rtn-block-32 -e dml
68
  ```
69
 
70
  ## Model Description
 
35
  pip install --pre onnxruntime-genai
36
 
37
  # Please adjust the model directory (-m) accordingly
38
+ curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-qa.py -o model-qa.py
39
+ python model-qa.py -m cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4 -e cpu
40
  ```
41
 
42
  For CUDA:
 
49
  pip install --pre onnxruntime-genai-cuda
50
 
51
  # Please adjust the model directory (-m) accordingly
52
+ curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-qa.py -o model-qa.py
53
+ python model-qa.py -m gpu/gpu-int4-rtn-block-32 -e cuda
54
  ```
55
 
56
  For DirectML:
 
63
  onnxruntime-genai-directml
64
 
65
  # Please adjust the model directory (-m) accordingly
66
+ curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-qa.py -o model-qa.py
67
+ python model-qa.py -m gpu/gpu-int4-rtn-block-32 -e dml
68
  ```
69
 
70
  ## Model Description