File size: 5,565 Bytes
624a781 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 | === Quantization Report === Model: SpectreSystems/KAT-Coder-V2.5-Dev-MTP Date: 2026-08-08 09:16:13 Version: 0.14.3 CLI Arguments: --batch_size 8 --iters 1000 --nsamples 512 --seqlen 2048 --dataset opencode-instruct --output_dir ./models/KAT-Coder-V2.5-Dev-MTP-int4-AutoRound Memory Summary: Peak RAM: 68.53 GB Peak VRAM: 28.52 GB Sensitivity Analysis: ───────────────────────────────────────────────────────────────────────────────────────────────────── Layer Cosine Sim PSNR (dB) Iters uLoss Status ───────────────────────────────────────────────────────────────────────────────────────────────────── 🟢 model.language_model.layers.0 0.9994 62.7 780 11 → 0 PASS 🟢 model.language_model.layers.1 0.9994 63.1 996 3 → 1 PASS 🟢 model.language_model.layers.2 0.9994 66.9 993 7 → 1 PASS 🟢 model.language_model.layers.3 0.9990 62.2 846 9 → 2 PASS 🟢 model.language_model.layers.4 0.9989 61.6 812 6 → 3 PASS 🟢 model.language_model.layers.5 0.9987 60.8 972 8 → 4 PASS 🟢 model.language_model.layers.6 0.9987 71.9 874 9 → 4 PASS 🟢 model.language_model.layers.7 0.9979 67.7 979 15 → 7 PASS 🟢 model.language_model.layers.8 0.9977 66.3 912 13 → 8 PASS 🟢 model.language_model.layers.9 0.9976 65.4 814 15 → 9 PASS 🟢 model.language_model.layers.10 0.9980 80.2 810 23 → 11 PASS 🟢 model.language_model.layers.11 0.9973 79.1 985 29 → 14 PASS 🟢 model.language_model.layers.12 0.9970 78.9 899 24 → 15 PASS 🟢 model.language_model.layers.13 0.9965 77.9 812 27 → 18 PASS 🟢 model.language_model.layers.14 0.9969 77.3 976 35 → 22 PASS 🟢 model.language_model.layers.15 0.9948 75.6 674 51 → 30 PASS 🟢 model.language_model.layers.16 0.9945 74.8 886 57 → 36 PASS 🟢 model.language_model.layers.17 0.9935 74.3 467 61 → 39 PASS 🟢 model.language_model.layers.18 0.9932 72.9 839 81 → 55 PASS 🟢 model.language_model.layers.19 0.9909 71.4 918 114 → 77 PASS 🟢 model.language_model.layers.20 0.9909 71.3 649 106 → 81 PASS 🟢 model.language_model.layers.21 0.9906 71.0 824 116 → 80 PASS 🟠 model.language_model.layers.22 0.9895 69.4 592 168 → 117 WARN 🟠 model.language_model.layers.23 0.9868 68.7 394 192 → 141 WARN 🟠 model.language_model.layers.24 0.9862 68.7 694 173 → 140 WARN 🟠 model.language_model.layers.25 0.9856 68.1 924 230 → 164 WARN 🟠 model.language_model.layers.26 0.9872 67.9 576 223 → 170 WARN 🟠 model.language_model.layers.27 0.9850 67.1 586 266 → 211 WARN 🟠 model.language_model.layers.28 0.9864 66.8 786 306 → 225 WARN 🟠 model.language_model.layers.29 0.9865 66.9 828 307 → 217 WARN 🟠 model.language_model.layers.30 0.9873 66.0 587 353 → 267 WARN 🟠 model.language_model.layers.31 0.9853 48.2 803 447 → 329 WARN 🟠 model.language_model.layers.32 0.9851 46.9 783 469 → 354 WARN 🟠 model.language_model.layers.33 0.9869 47.7 231 653 → 442 WARN 🟠 model.language_model.layers.34 0.9869 58.4 806 864 → 558 WARN 🟠 model.language_model.layers.35 0.9870 48.3 916 1070 → 737 WARN 🟠 model.language_model.layers.36 0.9867 47.2 913 1211 → 870 WARN 🟠 model.language_model.layers.37 0.9886 48.1 770 1607 → 1098 WARN 🟠 model.language_model.layers.38 0.9893 55.8 491 2262 → 1553 WARN 🟢 model.language_model.layers.39 0.9918 54.0 814 4543 → 2399 PASS Summary: Total blocks: 40 Passed (🟢): 23 Warning (🟠): 17 Thresholds: Cosine Similarity < 0.99, PSNR < 45.0 dB |