| --- |
| license: mit |
| language: |
| - en |
| pipeline_tag: text-generation |
| tags: |
| - amd |
| - ryzenai |
| - onnx |
| - npu_4K |
| --- |
| |
| # Phi-3.5-mini-instruct_rai_1.7.1_npu_4K |
|
|
| - ## Introduction |
|
|
| This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment (Full Fusion 4K context). |
|
|
| - ## Quantization Strategy |
| - AWQ / Group 128 / Asymmetric / BFP16 activations / UINT4 Weights |
|
|
| - ## Quick Start |
|
|
| For quickstart, refer to [Ryzen AI documentation](https://ryzenai.docs.amd.com/en/latest/hybrid_oga.html) |
|
|
| #### Evaluation scores |
|
|
| _Benchmark scores not yet available for this model._ |
|
|
| #### License |
|
|
| Modifications copyright(c) 2025 Advanced Micro Devices,Inc. All rights reserved. |
|
|
| MIT License |
|
|
| Copyright (c) 2025 Advanced Micro Devices, Inc |
|
|
| Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal |
| in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell |
| copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: |
| The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. |
|
|
| THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, |
| FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER |
| LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE |
| SOFTWARE. |
|
|
|
|
|
|
