2026-08-17 12:33:50,465 INFO Loading model: D:\amd\gemma-4-e4b-npu-eager-vnorm3\tmp\decoder\model.onnx
2026-08-17 12:33:50,507 INFO Detected phases — prefill=eager token=eager
2026-08-17 12:33:50,507 INFO FlashMHA: disabled
2026-08-17 12:33:50,507 INFO Preemption: disabled
2026-08-17 12:33:50,517 INFO Loaded txn manifest: C:\ProgramData\miniforge3\envs\hybrid-llm\Lib\site-packages\ryzenai_dynamic_dispatch\bin\dd_txn_manifest.json (static_lib=8667, dyn_bins=34442)
2026-08-17 12:33:50,517 INFO Filtering eager-mode bins from 1 graph(s)...
2026-08-17 12:33:50,925 DEBUG [eager/flat] DD bins collected for ops: {'MatMulNBitsBf': 301, 'GQO': 42}
2026-08-17 12:33:50,925 DEBUG [eager/flat]   BMM1 nh=8 kvh=2 hs=256: 26 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   BMM1 nh=8 kvh=2 hs=512: 26 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   BMM2 nh=8 kvh=2 hs=256: 25 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   BMM2 nh=8 kvh=2 hs=512: 25 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=10240 N=2560 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=256 N=2560 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=2560 N=1024 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=2560 N=10240 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=2560 N=2048 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=2560 N=256 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=2560 N=262144 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=2560 N=4096 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   MatMul K=2560 N=512 grp=32: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   RoPE nh=8 hs=256: 73 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   RoPE nh=8 hs=512: 39 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   Softmax nh=8 hs=256: 41 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   Softmax nh=8 hs=512: 25 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   o_proj MatMul K=2048 N=2560: 16 bins
2026-08-17 12:33:50,925 DEBUG [eager/flat]   o_proj MatMul K=4096 N=2560: 17 bins
2026-08-17 12:33:50,925 INFO   [eager/flat] DD get_all_txn_keys: 19 groups, 457 keys
2026-08-17 12:33:51,962 INFO === PREFILL+TOKEN PHASE — eager bin coverage ===
2026-08-17 12:33:51,962 INFO   [OK] BMM1 nh=8 kvh=2 hs=256 — requested=26 matched=26 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] BMM1 nh=8 kvh=2 hs=512 — requested=26 matched=26 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] BMM2 nh=8 kvh=2 hs=256 — requested=25 matched=25 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] BMM2 nh=8 kvh=2 hs=512 — requested=25 matched=25 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=10240 N=2560 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=256 N=2560 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=2560 N=1024 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=2560 N=10240 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=2560 N=2048 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=2560 N=256 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=2560 N=262144 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=2560 N=4096 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] MatMul K=2560 N=512 grp=32 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] RoPE nh=8 hs=256 — requested=73 matched=73 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] RoPE nh=8 hs=512 — requested=39 matched=39 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] Softmax nh=8 hs=256 — requested=41 matched=41 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] Softmax nh=8 hs=512 — requested=25 matched=25 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] o_proj MatMul K=2048 N=2560 — requested=16 matched=16 core_dll=0
2026-08-17 12:33:51,962 INFO   [OK] o_proj MatMul K=4096 N=2560 — requested=17 matched=17 core_dll=0
2026-08-17 12:33:51,962 INFO === PREFILL+TOKEN PHASE summary — matched 457 / 457 keys (0 in core dll, 0 missing) ===
2026-08-17 12:33:51,971 INFO Output (single source): D:\amd\gemma-4-e4b-npu-eager-vnorm3\tmp\decoder\cache\txn_bins.zip (452 entries)