microsoft
/

Phi-4-multimodal-instruct-onnx

Automatic Speech Recognition

speech-summarization

speech-translation

visual-question-answering

phi-4-multimodal

Model card Files Files and versions

LearnPhi3

#16

by onesrk9 - opened Dec 1, 2025

base: refs/heads/main

←

from: refs/pr/16

Discussion Files changed

This PR is in draft mode

Files changed (1) hide show

README.md +8 -11

README.md CHANGED Viewed

@@ -32,9 +32,8 @@ huggingface-cli download microsoft/Phi-4-multimodal-instruct-onnx --include cpu_
 pip install --pre onnxruntime-genai
 # Please adjust the model directory (-m) accordingly
-curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/common.py -o common.py
-curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-mm.py -o model-mm.py
-python model-mm.py -m cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4 -e cpu
 ``` -->
 For CUDA:
@@ -46,10 +45,9 @@ huggingface-cli download microsoft/Phi-4-multimodal-instruct-onnx --include gpu/
 # Install the CUDA package of ONNX Runtime GenAI
 pip install --pre onnxruntime-genai-cuda
-# Please adjust the model directory (-m) accordingly
-curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/common.py -o common.py
-curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-mm.py -o model-mm.py
-python model-mm.py -m gpu/gpu-int4-rtn-block-32 -e cuda
 ```
 For DirectML:
@@ -61,10 +59,9 @@ huggingface-cli download microsoft/Phi-4-multimodal-instruct-onnx --include gpu/
 # Install the DML package of ONNX Runtime GenAI
 pip install --pre onnxruntime-genai-directml
-# Please adjust the model directory (-m) accordingly
-curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/common.py -o common.py
-curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/model-mm.py -o model-mm.py
-python model-mm.py -m gpu/gpu-int4-rtn-block-32 -e dml
 ```
 You will be prompted to provide any images, audios, and a prompt.

 pip install --pre onnxruntime-genai
 # Please adjust the model directory (-m) accordingly
+curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi4-mm.py -o phi4-mm.py
+python phi4-mm.py -m cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4 -e cpu
 ``` -->
 For CUDA:
 # Install the CUDA package of ONNX Runtime GenAI
 pip install --pre onnxruntime-genai-cuda
+# Please adjust the model directory (-m) accordingly
+curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi4-mm.py -o phi4-mm.py
+python phi4-mm.py -m gpu/gpu-int4-rtn-block-32 -e cuda
 ```
 For DirectML:
 # Install the DML package of ONNX Runtime GenAI
 pip install --pre onnxruntime-genai-directml
+# Please adjust the model directory (-m) accordingly
+curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi4-mm.py -o phi4-mm.py
+python phi4-mm.py -m gpu/gpu-int4-rtn-block-32 -e dml
 ```
 You will be prompted to provide any images, audios, and a prompt.