| # ๊ฒฐ๊ณผ |
|
|
| | ๊ฒฝ๋ก | ๋ด์ฉ | |
| |---|---| |
| | `accuracy/model_accuracy.csv` | 21๊ฐ ๋ชจ๋ธ์ FP32ยท์์ํ ์ ํ๋์ ๋ณํ๋ | |
| | `accuracy/onnx_mlir_output_check.csv` | ์์ฑ๋ native ONNX-MLIR artifact์ ์ถ๋ ฅ ๋น๊ต | |
| | `conversion/pipeline_status.csv` | ์๋ณธ, ONNX, ONNX-MLIR ๋ณํ ์ํ | |
| | `conversion/ir_stage_coverage.csv` | ONNX Dialect, Krnl, Affine/SCF/MemRef, LLVM ๋จ๊ณ๋ณ ์ํ | |
| | `conversion/quantization_preservation.csv` | ONNX์ MLIR์ ์์ํ ์ ๋ณด ๋ณด์กด ์ํ | |
| | `graphs/netron/` | Netron FP32ยท์์ํ ONNX ๊ทธ๋ํ ์์ฑยท์ ์ฅ ์์น | |
| | `graphs/mlir/` | ONNX Dialect 42๊ฐ์ ์ ์ operation ์์์ SSA ์ฐ๊ฒฐ ๊ทธ๋ํ | |
|
|
| ## ๋ชจ๋ธ ์ ํ๋ ๊ฒฐ๊ณผ |
|
|
| ์ ์ฒด CSV: [`accuracy/model_accuracy.csv`](accuracy/model_accuracy.csv) |
|
|
| | ID | ์ ํ๋ ์งํ | FP32 | ์์ํ | ๋ณํ๋ | ๊ณต๊ฐ ์์น ๋น๊ต | |
| |---|---|---:|---:|---:|---| |
| | AD01 | AUC / pAUC | 0.876001 / 0.764121 | 0.840250 / 0.720049 | -0.035750 / -0.044071 | ๊ณต๊ฐ FP32 ์์น์ ๋์ผ | |
| | LM04 | AUROC / TPR@FPR 5% / 1% | 0.667078 / 0.318983 / 0.233873 | 0.668862 / 0.322615 / 0.235853 | +0.001785 / +0.003632 / +0.001981 | ๊ณต๊ฐ ์์น ์์. | |
| | OD06 | COCO bbox mAP | 24.8751% | 24.2822% | -0.5929 pp | ๊ณต๊ฐ ์์น ์์. | |
| | OD07 | COCO bbox mAP | 31.8594% | 31.4191% | -0.4403 pp | ๊ณต๊ฐ ์์น ์์. | |
| | SG06 | mIoU | 75.6398% | 74.1290% | -1.5108 pp | ๊ณต๊ฐ FP32 75.32%, ์ฐจ์ด +0.3198 pp | |
| | SG07 | mIoU | 70.6473% | 69.6191% | -1.0282 pp | ๊ณต๊ฐ FP32 70.19%, ์ฐจ์ด +0.4573 pp | |
| | SG08 | CamVid mIoU | 50.6498% | 51.1600% | +0.5102 pp | ๊ณต๊ฐ ์์น ์์. | |
| | SP01 | Top-1 accuracy | 91.86% | 91.66% | -0.2045 pp | ๊ณต๊ฐ ์ํ ์ ํ๋ ์ฝ 92%์ ๊ทผ์ | |
| | SP02 | FP / FN | 5 / 6 | 4 / 6 | -1 / 0 | ๊ณต๊ฐ ์์น ์์. | |
| | SP08 | Yes/No Top-1 accuracy | 94.05% | 94.05% | 0.0000 pp | ๊ณต๊ฐ ์์น ์์. | |
| | SP09 | Top-1 accuracy | 95.06% | 94.70% | -0.3590 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC01 | Top-1 accuracy | 85.10% | 85.60% | +0.5000 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC02 | Top-1 accuracy | 87.00% | 87.00% | 0.0000 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC03 | Top-1 / Top-5 accuracy | 49.80% / 74.20% | 48.00% / 72.80% | -1.8000 / -1.4000 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC04 | Top-1 / Top-5 accuracy | 63.30% / 84.90% | 60.70% / 83.20% | -2.6000 / -1.7000 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC05 | Top-1 accuracy | 58.13% | 56.77% | -1.3600 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC06 | Top-1 accuracy | 66.20% | 65.31% | -0.8900 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC09 | Top-1 / Top-5 accuracy | 56.85% / 79.87% | 56.48% / 79.76% | -0.3700 / -0.1100 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC11 | Top-1 accuracy | 75.10% | 74.40% | -0.7000 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC12 | Top-1 / Top-5 accuracy | 69.48% / 89.26% | 68.30% / 88.44% | -1.1800 / -0.8200 pp | ๊ณต๊ฐ ์์น ์์. | |
| | VC13 | Top-1 / Top-5 error | 33.65% / 13.43% | 33.85% / 13.66% | +0.2000 / +0.2300 pp | ๊ณต๊ฐ ์์น ์์. | |
|
|
| VC13์ accuracy๊ฐ ์๋๋ผ error์ด๋ฏ๋ก ๊ฐ์ด ๋ฎ์์๋ก ์ข์ |
|
|