๋ชจ๋ธ๋ณ ๋ณํ ๊ฒฐ๊ณผ
๊ฐ ๋ชจ๋ธ์ FP32ยท์์ํ ์๋ณธ ๋ณต์ฌ๋ณธ, ๋ณํ ONNX, ONNX Runtime ์ถ๋ ฅ ๋น๊ต, ONNX-MLIR ํ์ผ์ ์ ์ฅํ๋ค.
models/<task>/<model_id>/
โโโ source/ ์๋ณธ FP32ยท์์ํ ๋ชจ๋ธ
โโโ baseline/ ์๋ณธ ์คํ ๊ฒ์ฆ
โโโ onnx/ ๋ณํ ONNX์ ์ถ๋ ฅ ๋น๊ต
โโโ mlir/ ONNX-MLIR ๋ณํ ๊ฒฐ๊ณผ
โโโ graphs/netron Netron ONNX PNG์ ๋ฉํ๋ฐ์ดํฐ
โโโ run_result.json
์๋ณธ ๋ชจ๋ธ์ research/downloads/์ ์๊ณ ๊ฒฝ๋ก์ SHA-256์ ../model_registry.csv์ ๊ธฐ๋ก๋์ด ์๋ค.
๊ณต๊ฐ ์์ํ ๋ชจ๋ธ ์ ๋ฐ๋
์๋ ์ ๋ฐ๋๋ ์๋ก ์์ํํ ๊ฒฐ๊ณผ๊ฐ ์๋๋ผ ํ๋ณดํ ๊ณต๊ฐ ์์ํ artifact์ ๊ตฌ์กฐ๋ฅผ ๊ฒ์ฌํ ๊ฐ์ด๋ค. INT8์ signed 8-bit, UINT8์ unsigned 8-bit์ด๋ฉฐ, ์์ํ convolution๊ณผ dense ์ฐ์ฐ์ ๋์ฐ๊ธฐ๋ ์ผ๋ฐ์ ์ผ๋ก INT32๋ฅผ ์ฌ์ฉํ๋ค. ๋ด๋ถ ์ฐ์ฐ์ด 8-bit์ฌ๋ ๋ชจ๋ธ ์
์ถ๋ ฅ ๊ฒฝ๊ณ๋ FP32์ผ ์ ์๋ค.
| ๋ชจ๋ธ | ์์ํ ๋ฐฉ์ | ๊ฐ์ค์น ์ ๋ฐ๋ | activation/core ์ ๋ฐ๋ | ๋ชจ๋ธ ์ ๋ ฅ โ ์ถ๋ ฅ |
|---|---|---|---|---|
| AD01 | Static PTQ, full integer | INT8 | INT8 | INT8 โ INT8 |
| LM04 | Dynamic ONNX quantization | INT8/UINT8 | ์ ํ MatMul์ dynamic UINT8, ๋๋จธ์ง๋ FP32 | INT64 tokens โ FP32 |
| OD06 | Static full-integer core | INT8 | INT8 | UINT8 โ FP32 raw heads |
| OD07 | Static full-integer core | INT8 | INT8 | UINT8 โ FP32 raw heads |
| SG06 | Full integer | UINT8 | UINT8 | UINT8 โ INT64 class IDs |
| SG07 | Full integer | UINT8 | UINT8 | UINT8 โ INT64 class IDs |
| SG08 | Full integer | UINT8 | UINT8 | UINT8 โ INT64 class IDs |
| SP01 | Static full integer | INT8 | INT8 | INT8 โ INT8 |
| SP02 | Full-integer public artifact | INT8 | INT8 | INT8 โ INT8 |
| SP08 | Full integer, legacy UINT8 artifact | UINT8 | UINT8 | UINT8 โ UINT8 |
| SP09 | Clustered model + static PTQ | INT8 | INT8 | INT8 โ INT8 |
| VC01 | Static full integer | INT8 | INT8 | INT8 โ INT8 |
| VC02 | Static full integer | INT8 | INT8 | INT8 โ INT8 |
| VC03 | QAT/FakeQuant + full integer | UINT8 | UINT8 | UINT8 โ UINT8 |
| VC04 | QAT/FakeQuant + full integer | UINT8 | UINT8 | UINT8 โ UINT8 |
| VC05 | Static INT8 | INT8 | INT8 | UINT8 โ FP32 |
| VC06 | Static Q/DQ INT8 ONNX | INT8 | INT8 core with FP32 boundaries | FP32 โ FP32 |
| VC09 | Static PTQ ONNX | INT8 | UINT8/INT8 core with FP32 boundaries | FP32 โ FP32 |
| VC11 | Static full integer | INT8 | INT8/UINT8 | UINT8 โ UINT8 |
| VC12 | Static PTQ ONNX | INT8 | UINT8/INT8 core with FP32 boundaries | FP32 โ FP32 |
| VC13 | Static PTQ, mixed QOperator/QDQ | INT8 | UINT8/INT8 core with FP32 boundaries | FP32 โ FP32 |
๋ชจ๋ธ๋ณ scale, zero point, ONNX ํํ๊ณผ ONNX-MLIR ๋ณด์กด ๊ฒฐ๊ณผ๋ ../reports/conversion/quantization_preservation.csv์ ์๋ค.