Update README.md
Browse files
README.md
CHANGED
|
@@ -8,4 +8,6 @@ run phi3-mini on AMD NPU
|
|
| 8 |
|
| 9 |
reference:https://github.com/amd/RyzenAI-SW/tree/main/example/transformers
|
| 10 |
|
| 11 |
-
As the quantization of phi-3, may refer to https://github.com/mit-han-lab/llm-awq/pull/183
|
|
|
|
|
|
|
|
|
| 8 |
|
| 9 |
reference:https://github.com/amd/RyzenAI-SW/tree/main/example/transformers
|
| 10 |
|
| 11 |
+
As the quantization of phi-3, may refer to https://github.com/mit-han-lab/llm-awq/pull/183
|
| 12 |
+
|
| 13 |
+
PS: The performance is similar to that on CPU(7640hs).
|