| 2026-08-17 12:33:50,465 INFO Loading model: D:\amd\gemma-4-e4b-npu-eager-vnorm3\tmp\decoder\model.onnx | |
| 2026-08-17 12:33:50,507 INFO Detected phases — prefill=eager token=eager | |
| 2026-08-17 12:33:50,507 INFO FlashMHA: disabled | |
| 2026-08-17 12:33:50,507 INFO Preemption: disabled | |
| 2026-08-17 12:33:50,517 INFO Loaded txn manifest: C:\ProgramData\miniforge3\envs\hybrid-llm\Lib\site-packages\ryzenai_dynamic_dispatch\bin\dd_txn_manifest.json (static_lib=8667, dyn_bins=34442) | |
| 2026-08-17 12:33:50,517 INFO Filtering eager-mode bins from 1 graph(s)... | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] DD bins collected for ops: {'MatMulNBitsBf': 301, 'GQO': 42} | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] BMM1 nh=8 kvh=2 hs=256: 26 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] BMM1 nh=8 kvh=2 hs=512: 26 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] BMM2 nh=8 kvh=2 hs=256: 25 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] BMM2 nh=8 kvh=2 hs=512: 25 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=10240 N=2560 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=256 N=2560 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=1024 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=10240 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=2048 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=256 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=262144 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=4096 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] MatMul K=2560 N=512 grp=32: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] RoPE nh=8 hs=256: 73 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] RoPE nh=8 hs=512: 39 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] Softmax nh=8 hs=256: 41 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] Softmax nh=8 hs=512: 25 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] o_proj MatMul K=2048 N=2560: 16 bins | |
| 2026-08-17 12:33:50,925 DEBUG [eager/flat] o_proj MatMul K=4096 N=2560: 17 bins | |
| 2026-08-17 12:33:50,925 INFO [eager/flat] DD get_all_txn_keys: 19 groups, 457 keys | |
| 2026-08-17 12:33:51,962 INFO === PREFILL+TOKEN PHASE — eager bin coverage === | |
| 2026-08-17 12:33:51,962 INFO [OK] BMM1 nh=8 kvh=2 hs=256 — requested=26 matched=26 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] BMM1 nh=8 kvh=2 hs=512 — requested=26 matched=26 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] BMM2 nh=8 kvh=2 hs=256 — requested=25 matched=25 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] BMM2 nh=8 kvh=2 hs=512 — requested=25 matched=25 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=10240 N=2560 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=256 N=2560 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=1024 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=10240 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=2048 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=256 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=262144 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=4096 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] MatMul K=2560 N=512 grp=32 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] RoPE nh=8 hs=256 — requested=73 matched=73 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] RoPE nh=8 hs=512 — requested=39 matched=39 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] Softmax nh=8 hs=256 — requested=41 matched=41 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] Softmax nh=8 hs=512 — requested=25 matched=25 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] o_proj MatMul K=2048 N=2560 — requested=16 matched=16 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO [OK] o_proj MatMul K=4096 N=2560 — requested=17 matched=17 core_dll=0 | |
| 2026-08-17 12:33:51,962 INFO === PREFILL+TOKEN PHASE summary — matched 457 / 457 keys (0 in core dll, 0 missing) === | |
| 2026-08-17 12:33:51,971 INFO Output (single source): D:\amd\gemma-4-e4b-npu-eager-vnorm3\tmp\decoder\cache\txn_bins.zip (452 entries) | |