| # ๋ชจ๋ธ๋ณ ๋ณํ ๊ฒฐ๊ณผ |
|
|
| ๊ฐ ๋ชจ๋ธ์ FP32ยท์์ํ ์๋ณธ ๋ณต์ฌ๋ณธ, ๋ณํ ONNX, ONNX Runtime ์ถ๋ ฅ ๋น๊ต, ONNX-MLIR ํ์ผ์ ์ ์ฅํ๋ค. |
|
|
| ```text |
| models/<task>/<model_id>/ |
| โโโ source/ ์๋ณธ FP32ยท์์ํ ๋ชจ๋ธ |
| โโโ baseline/ ์๋ณธ ์คํ ๊ฒ์ฆ |
| โโโ onnx/ ๋ณํ ONNX์ ์ถ๋ ฅ ๋น๊ต |
| โโโ mlir/ ONNX-MLIR ๋ณํ ๊ฒฐ๊ณผ |
| โโโ graphs/netron Netron ONNX PNG์ ๋ฉํ๋ฐ์ดํฐ |
| โโโ run_result.json |
| ``` |
|
|
| ์๋ณธ ๋ชจ๋ธ์ `research/downloads/`์ ์๊ณ ๊ฒฝ๋ก์ SHA-256์ [`../model_registry.csv`](../model_registry.csv)์ ๊ธฐ๋ก๋์ด ์๋ค. |
|
|
| ## ๊ณต๊ฐ ์์ํ ๋ชจ๋ธ ์ ๋ฐ๋ |
|
|
| ์๋ ์ ๋ฐ๋๋ ์๋ก ์์ํํ ๊ฒฐ๊ณผ๊ฐ ์๋๋ผ ํ๋ณดํ ๊ณต๊ฐ ์์ํ artifact์ ๊ตฌ์กฐ๋ฅผ ๊ฒ์ฌํ ๊ฐ์ด๋ค. `INT8`์ signed 8-bit, `UINT8`์ unsigned 8-bit์ด๋ฉฐ, ์์ํ convolution๊ณผ dense ์ฐ์ฐ์ ๋์ฐ๊ธฐ๋ ์ผ๋ฐ์ ์ผ๋ก INT32๋ฅผ ์ฌ์ฉํ๋ค. ๋ด๋ถ ์ฐ์ฐ์ด 8-bit์ฌ๋ ๋ชจ๋ธ ์
์ถ๋ ฅ ๊ฒฝ๊ณ๋ FP32์ผ ์ ์๋ค. |
|
|
| | ๋ชจ๋ธ | ์์ํ ๋ฐฉ์ | ๊ฐ์ค์น ์ ๋ฐ๋ | activation/core ์ ๋ฐ๋ | ๋ชจ๋ธ ์
๋ ฅ โ ์ถ๋ ฅ | |
| |---|---|---|---|---| |
| | AD01 | Static PTQ, full integer | INT8 | INT8 | INT8 โ INT8 | |
| | LM04 | Dynamic ONNX quantization | INT8/UINT8 | ์ ํ MatMul์ dynamic UINT8, ๋๋จธ์ง๋ FP32 | INT64 tokens โ FP32 | |
| | OD06 | Static full-integer core | INT8 | INT8 | UINT8 โ FP32 raw heads | |
| | OD07 | Static full-integer core | INT8 | INT8 | UINT8 โ FP32 raw heads | |
| | SG06 | Full integer | UINT8 | UINT8 | UINT8 โ INT64 class IDs | |
| | SG07 | Full integer | UINT8 | UINT8 | UINT8 โ INT64 class IDs | |
| | SG08 | Full integer | UINT8 | UINT8 | UINT8 โ INT64 class IDs | |
| | SP01 | Static full integer | INT8 | INT8 | INT8 โ INT8 | |
| | SP02 | Full-integer public artifact | INT8 | INT8 | INT8 โ INT8 | |
| | SP08 | Full integer, legacy UINT8 artifact | UINT8 | UINT8 | UINT8 โ UINT8 | |
| | SP09 | Clustered model + static PTQ | INT8 | INT8 | INT8 โ INT8 | |
| | VC01 | Static full integer | INT8 | INT8 | INT8 โ INT8 | |
| | VC02 | Static full integer | INT8 | INT8 | INT8 โ INT8 | |
| | VC03 | QAT/FakeQuant + full integer | UINT8 | UINT8 | UINT8 โ UINT8 | |
| | VC04 | QAT/FakeQuant + full integer | UINT8 | UINT8 | UINT8 โ UINT8 | |
| | VC05 | Static INT8 | INT8 | INT8 | UINT8 โ FP32 | |
| | VC06 | Static Q/DQ INT8 ONNX | INT8 | INT8 core with FP32 boundaries | FP32 โ FP32 | |
| | VC09 | Static PTQ ONNX | INT8 | UINT8/INT8 core with FP32 boundaries | FP32 โ FP32 | |
| | VC11 | Static full integer | INT8 | INT8/UINT8 | UINT8 โ UINT8 | |
| | VC12 | Static PTQ ONNX | INT8 | UINT8/INT8 core with FP32 boundaries | FP32 โ FP32 | |
| | VC13 | Static PTQ, mixed QOperator/QDQ | INT8 | UINT8/INT8 core with FP32 boundaries | FP32 โ FP32 | |
|
|
| ๋ชจ๋ธ๋ณ scale, zero point, ONNX ํํ๊ณผ ONNX-MLIR ๋ณด์กด ๊ฒฐ๊ณผ๋ [`../reports/conversion/quantization_preservation.csv`](../reports/conversion/quantization_preservation.csv)์ ์๋ค. |
|
|