File size: 4,516 Bytes
f40a829 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 | 2026-08-17 12:33:50,465 INFO Loading model: D:\amd\gemma-4-e4b-npu-eager-vnorm3\tmp\decoder\model.onnx
2026-08-17 12:33:50,507 INFO Detected phases — prefill=eager token=eager
2026-08-17 12:33:50,507 INFO FlashMHA: disabled
2026-08-17 12:33:50,507 INFO Preemption: disabled
2026-08-17 12:33:50,517 INFO Loaded txn manifest: C:\ProgramData\miniforge3\envs\hybrid-llm\Lib\site-packages\ryzenai_dynamic_dispatch\bin\dd_txn_manifest.json (static_lib=8667, dyn_bins=34442)
2026-08-17 12:33:50,517 INFO Filtering eager-mode bins from 1 graph(s)...
2026-08-17 12:33:50,925 DEBUG [eager/flat] DD bins collected for ops: {'MatMulNBitsBf': 301, 'GQO': 42}
2026-08-17 12:33:50,925 DEBUG [eager/flat] BMM1 nh=8 kvh=2 hs=256: 26 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] BMM1 nh=8 kvh=2 hs=512: 26 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] BMM2 nh=8 kvh=2 hs=256: 25 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] BMM2 nh=8 kvh=2 hs=512: 25 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=10240 N=2560 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=256 N=2560 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=1024 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=10240 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=2048 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=256 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=262144 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=4096 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=512 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] RoPE nh=8 hs=256: 73 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] RoPE nh=8 hs=512: 39 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] Softmax nh=8 hs=256: 41 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] Softmax nh=8 hs=512: 25 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] o_proj MatMul K=2048 N=2560: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat] o_proj MatMul K=4096 N=2560: 17 bins
2026-08-17 12:33:50,925 INFO [eager/flat] DD get_all_txn_keys: 19 groups, 457 keys
2026-08-17 12:33:51,962 INFO === PREFILL+TOKEN PHASE — eager bin coverage ===
2026-08-17 12:33:51,962 INFO [OK] BMM1 nh=8 kvh=2 hs=256 — requested=26 matched=26 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] BMM1 nh=8 kvh=2 hs=512 — requested=26 matched=26 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] BMM2 nh=8 kvh=2 hs=256 — requested=25 matched=25 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] BMM2 nh=8 kvh=2 hs=512 — requested=25 matched=25 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=10240 N=2560 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=256 N=2560 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=1024 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=10240 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=2048 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=256 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=262144 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=4096 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=512 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] RoPE nh=8 hs=256 — requested=73 matched=73 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] RoPE nh=8 hs=512 — requested=39 matched=39 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] Softmax nh=8 hs=256 — requested=41 matched=41 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] Softmax nh=8 hs=512 — requested=25 matched=25 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] o_proj MatMul K=2048 N=2560 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO [OK] o_proj MatMul K=4096 N=2560 — requested=17 matched=17 core_dll=0
2026-08-17 12:33:51,962 INFO === PREFILL+TOKEN PHASE summary — matched 457 / 457 keys (0 in core dll, 0 missing) ===
2026-08-17 12:33:51,971 INFO Output (single source): D:\amd\gemma-4-e4b-npu-eager-vnorm3\tmp\decoder\cache\txn_bins.zip (452 entries)
|