| # Xplain Task Vector Analysis Summary |
|
|
| Base/checkpoint groups: |
|
|
| - `granite-3.3-8b-base`: `ibm-granite/granite-3.3-8b-base` |
| - `xplain1.4-7base-32k-step1743`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-7base/32k/checkpoint/ckpt_step_1743` |
| - `granite-3.1-8b-base`: `ibm-granite/granite-3.1-8b-base` |
| - `xplain1.4-6base-64k-step1743`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-6base-64k/checkpoint/ckpt_step_1743` |
| - `xplain1.4-6base-32k-step1743`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-6base-32k/checkpoint/ckpt_step_1743` |
| - `xplain1.4-6base-16k-step2319`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-6base-16k/checkpoint/ckpt_step_2319` |
| - `xplain1.4-6base-8k-step2319`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-6base-8k/checkpoint/ckpt_step_2319` |
| - `xplain1.3-6base-64k-step1647`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.3-6base-64k/checkpoint/ckpt_step_1647` |
| - `xplain1.3-6base-32k-step1647`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.3-6base-32k/checkpoint/ckpt_step_1647` |
| - `xplain1.3-6base-16k-step2199`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.3-6base-16k/checkpoint/ckpt_step_2199` |
| - `xplain1.3-6base-8k-step2199`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.3-6base-8k/checkpoint/ckpt_step_2199` |
| Base model: `multiple-base-models` |
|
|
| Finetuned models: |
|
|
| - `xplain1.4-7base-32k-step1743 vs granite-3.3-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-7base/32k/checkpoint/ckpt_step_1743` |
| - `xplain1.4-6base-64k-step1743 vs granite-3.1-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-6base-64k/checkpoint/ckpt_step_1743` |
| - `xplain1.4-6base-32k-step1743 vs granite-3.1-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-6base-32k/checkpoint/ckpt_step_1743` |
| - `xplain1.4-6base-16k-step2319 vs granite-3.1-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-6base-16k/checkpoint/ckpt_step_2319` |
| - `xplain1.4-6base-8k-step2319 vs granite-3.1-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.4-6base-8k/checkpoint/ckpt_step_2319` |
| - `xplain1.3-6base-64k-step1647 vs granite-3.1-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.3-6base-64k/checkpoint/ckpt_step_1647` |
| - `xplain1.3-6base-32k-step1647 vs granite-3.1-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.3-6base-32k/checkpoint/ckpt_step_1647` |
| - `xplain1.3-6base-16k-step2199 vs granite-3.1-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.3-6base-16k/checkpoint/ckpt_step_2199` |
| - `xplain1.3-6base-8k-step2199 vs granite-3.1-8b-base`: `/wca4z-pvc-ckpt/shared/model_delivery_experiments/xplain-long/xplain1.3-6base-8k/checkpoint/ckpt_step_2199` |
|
|
| Statistic mode: `signed` |
|
|
| Sublayer granularity: `module` |
|
|
| Include non-layer parameters: `False` |
|
|
| Device: `cuda:0` |
|
|
| Compute dtype: `torch.float32` |
|
|
| Summary top-k per model: `50` |
|
|
| ## Output files |
|
|
| - `parameter_stats.csv` |
| - `sublayer_stats.csv` |
| - `layerwise_stats.csv` |
| - `module_type_stats.csv` |
| - `sublayer_std.pdf` |
| - `layerwise_std.pdf` |
| - `module_type_std.pdf` |
|
|
| ## Compared parameter tensors |
|
|
| - `xplain1.3-6base-16k-step2199`: 360 parameter tensors |
| - `xplain1.3-6base-32k-step1647`: 360 parameter tensors |
| - `xplain1.3-6base-64k-step1647`: 360 parameter tensors |
| - `xplain1.3-6base-8k-step2199`: 360 parameter tensors |
| - `xplain1.4-6base-16k-step2319`: 360 parameter tensors |
| - `xplain1.4-6base-32k-step1743`: 360 parameter tensors |
| - `xplain1.4-6base-64k-step1743`: 360 parameter tensors |
| - `xplain1.4-6base-8k-step2319`: 360 parameter tensors |
| - `xplain1.4-7base-32k-step1743`: 360 parameter tensors |
|
|
| ## Top sublayers by std |
|
|
| ### `xplain1.3-6base-16k-step2199` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.3-6base-16k-step2199 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.003985 signed |
| xplain1.3-6base-16k-step2199 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.003845 signed |
| xplain1.3-6base-16k-step2199 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.003739 signed |
| xplain1.3-6base-16k-step2199 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.002777 signed |
| xplain1.3-6base-16k-step2199 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.002399 signed |
| xplain1.3-6base-16k-step2199 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.001991 signed |
| xplain1.3-6base-16k-step2199 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.001628 signed |
| xplain1.3-6base-16k-step2199 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.001616 signed |
| xplain1.3-6base-16k-step2199 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.001615 signed |
| xplain1.3-6base-16k-step2199 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.001575 signed |
| xplain1.3-6base-16k-step2199 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001559 signed |
| xplain1.3-6base-16k-step2199 Layer 17 | input_layernorm Layer 17 input_layernorm 4096 0.001556 signed |
| xplain1.3-6base-16k-step2199 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001552 signed |
| xplain1.3-6base-16k-step2199 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.001551 signed |
| xplain1.3-6base-16k-step2199 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001546 signed |
| xplain1.3-6base-16k-step2199 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001495 signed |
| xplain1.3-6base-16k-step2199 Layer 00 | input_layernorm Layer 00 input_layernorm 4096 0.001493 signed |
| xplain1.3-6base-16k-step2199 Layer 36 | input_layernorm Layer 36 input_layernorm 4096 0.001488 signed |
| xplain1.3-6base-16k-step2199 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001483 signed |
| xplain1.3-6base-16k-step2199 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.001481 signed |
| xplain1.3-6base-16k-step2199 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001466 signed |
| xplain1.3-6base-16k-step2199 Layer 35 | input_layernorm Layer 35 input_layernorm 4096 0.001441 signed |
| xplain1.3-6base-16k-step2199 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.001440 signed |
| xplain1.3-6base-16k-step2199 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.001434 signed |
| xplain1.3-6base-16k-step2199 Layer 35 | self_attn.q_proj Layer 35 self_attn.q_proj 16777216 0.001433 signed |
| xplain1.3-6base-16k-step2199 Layer 34 | mlp.down_proj Layer 34 mlp.down_proj 52428800 0.001420 signed |
| xplain1.3-6base-16k-step2199 Layer 37 | input_layernorm Layer 37 input_layernorm 4096 0.001418 signed |
| xplain1.3-6base-16k-step2199 Layer 36 | mlp.down_proj Layer 36 mlp.down_proj 52428800 0.001414 signed |
| xplain1.3-6base-16k-step2199 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001409 signed |
| xplain1.3-6base-16k-step2199 Layer 37 | self_attn.q_proj Layer 37 self_attn.q_proj 16777216 0.001401 signed |
| xplain1.3-6base-16k-step2199 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001398 signed |
| xplain1.3-6base-16k-step2199 Layer 37 | mlp.down_proj Layer 37 mlp.down_proj 52428800 0.001396 signed |
| xplain1.3-6base-16k-step2199 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.001388 signed |
| xplain1.3-6base-16k-step2199 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.001375 signed |
| xplain1.3-6base-16k-step2199 Layer 35 | mlp.down_proj Layer 35 mlp.down_proj 52428800 0.001369 signed |
| xplain1.3-6base-16k-step2199 Layer 38 | mlp.down_proj Layer 38 mlp.down_proj 52428800 0.001368 signed |
| xplain1.3-6base-16k-step2199 Layer 39 | mlp.up_proj Layer 39 mlp.up_proj 52428800 0.001366 signed |
| xplain1.3-6base-16k-step2199 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.001363 signed |
| xplain1.3-6base-16k-step2199 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.001358 signed |
| xplain1.3-6base-16k-step2199 Layer 28 | mlp.gate_proj Layer 28 mlp.gate_proj 52428800 0.001356 signed |
| xplain1.3-6base-16k-step2199 Layer 21 | self_attn.q_proj Layer 21 self_attn.q_proj 16777216 0.001356 signed |
| xplain1.3-6base-16k-step2199 Layer 27 | mlp.gate_proj Layer 27 mlp.gate_proj 52428800 0.001351 signed |
| xplain1.3-6base-16k-step2199 Layer 36 | self_attn.k_proj Layer 36 self_attn.k_proj 4194304 0.001351 signed |
| xplain1.3-6base-16k-step2199 Layer 33 | mlp.up_proj Layer 33 mlp.up_proj 52428800 0.001349 signed |
| xplain1.3-6base-16k-step2199 Layer 29 | mlp.down_proj Layer 29 mlp.down_proj 52428800 0.001347 signed |
| xplain1.3-6base-16k-step2199 Layer 31 | mlp.down_proj Layer 31 mlp.down_proj 52428800 0.001344 signed |
| xplain1.3-6base-16k-step2199 Layer 31 | mlp.up_proj Layer 31 mlp.up_proj 52428800 0.001343 signed |
| xplain1.3-6base-16k-step2199 Layer 26 | mlp.gate_proj Layer 26 mlp.gate_proj 52428800 0.001343 signed |
| xplain1.3-6base-16k-step2199 Layer 28 | mlp.down_proj Layer 28 mlp.down_proj 52428800 0.001340 signed |
| xplain1.3-6base-16k-step2199 Layer 30 | mlp.down_proj Layer 30 mlp.down_proj 52428800 0.001340 signed |
| |
| ### `xplain1.3-6base-32k-step1647` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.3-6base-32k-step1647 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.005447 signed |
| xplain1.3-6base-32k-step1647 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.005222 signed |
| xplain1.3-6base-32k-step1647 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.005059 signed |
| xplain1.3-6base-32k-step1647 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.003657 signed |
| xplain1.3-6base-32k-step1647 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.003223 signed |
| xplain1.3-6base-32k-step1647 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.002641 signed |
| xplain1.3-6base-32k-step1647 Layer 36 | input_layernorm Layer 36 input_layernorm 4096 0.001945 signed |
| xplain1.3-6base-32k-step1647 Layer 17 | input_layernorm Layer 17 input_layernorm 4096 0.001918 signed |
| xplain1.3-6base-32k-step1647 Layer 00 | input_layernorm Layer 00 input_layernorm 4096 0.001915 signed |
| xplain1.3-6base-32k-step1647 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.001854 signed |
| xplain1.3-6base-32k-step1647 Layer 37 | input_layernorm Layer 37 input_layernorm 4096 0.001846 signed |
| xplain1.3-6base-32k-step1647 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.001841 signed |
| xplain1.3-6base-32k-step1647 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.001839 signed |
| xplain1.3-6base-32k-step1647 Layer 35 | input_layernorm Layer 35 input_layernorm 4096 0.001798 signed |
| xplain1.3-6base-32k-step1647 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.001796 signed |
| xplain1.3-6base-32k-step1647 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001786 signed |
| xplain1.3-6base-32k-step1647 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001780 signed |
| xplain1.3-6base-32k-step1647 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001771 signed |
| xplain1.3-6base-32k-step1647 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.001767 signed |
| xplain1.3-6base-32k-step1647 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001721 signed |
| xplain1.3-6base-32k-step1647 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001705 signed |
| xplain1.3-6base-32k-step1647 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.001701 signed |
| xplain1.3-6base-32k-step1647 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001669 signed |
| xplain1.3-6base-32k-step1647 Layer 30 | input_layernorm Layer 30 input_layernorm 4096 0.001663 signed |
| xplain1.3-6base-32k-step1647 Layer 31 | input_layernorm Layer 31 input_layernorm 4096 0.001660 signed |
| xplain1.3-6base-32k-step1647 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001646 signed |
| xplain1.3-6base-32k-step1647 Layer 19 | input_layernorm Layer 19 input_layernorm 4096 0.001646 signed |
| xplain1.3-6base-32k-step1647 Layer 35 | self_attn.q_proj Layer 35 self_attn.q_proj 16777216 0.001643 signed |
| xplain1.3-6base-32k-step1647 Layer 34 | mlp.down_proj Layer 34 mlp.down_proj 52428800 0.001639 signed |
| xplain1.3-6base-32k-step1647 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.001634 signed |
| xplain1.3-6base-32k-step1647 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.001634 signed |
| xplain1.3-6base-32k-step1647 Layer 36 | mlp.down_proj Layer 36 mlp.down_proj 52428800 0.001630 signed |
| xplain1.3-6base-32k-step1647 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001624 signed |
| xplain1.3-6base-32k-step1647 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.001623 signed |
| xplain1.3-6base-32k-step1647 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.001612 signed |
| xplain1.3-6base-32k-step1647 Layer 37 | mlp.down_proj Layer 37 mlp.down_proj 52428800 0.001598 signed |
| xplain1.3-6base-32k-step1647 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.001596 signed |
| xplain1.3-6base-32k-step1647 Layer 37 | self_attn.q_proj Layer 37 self_attn.q_proj 16777216 0.001596 signed |
| xplain1.3-6base-32k-step1647 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.001587 signed |
| xplain1.3-6base-32k-step1647 Layer 29 | mlp.down_proj Layer 29 mlp.down_proj 52428800 0.001586 signed |
| xplain1.3-6base-32k-step1647 Layer 28 | mlp.gate_proj Layer 28 mlp.gate_proj 52428800 0.001582 signed |
| xplain1.3-6base-32k-step1647 Layer 31 | mlp.down_proj Layer 31 mlp.down_proj 52428800 0.001582 signed |
| xplain1.3-6base-32k-step1647 Layer 33 | mlp.up_proj Layer 33 mlp.up_proj 52428800 0.001581 signed |
| xplain1.3-6base-32k-step1647 Layer 35 | mlp.down_proj Layer 35 mlp.down_proj 52428800 0.001580 signed |
| xplain1.3-6base-32k-step1647 Layer 30 | mlp.down_proj Layer 30 mlp.down_proj 52428800 0.001580 signed |
| xplain1.3-6base-32k-step1647 Layer 31 | mlp.up_proj Layer 31 mlp.up_proj 52428800 0.001579 signed |
| xplain1.3-6base-32k-step1647 Layer 28 | mlp.down_proj Layer 28 mlp.down_proj 52428800 0.001577 signed |
| xplain1.3-6base-32k-step1647 Layer 27 | mlp.gate_proj Layer 27 mlp.gate_proj 52428800 0.001575 signed |
| xplain1.3-6base-32k-step1647 Layer 39 | mlp.up_proj Layer 39 mlp.up_proj 52428800 0.001573 signed |
| xplain1.3-6base-32k-step1647 Layer 21 | self_attn.q_proj Layer 21 self_attn.q_proj 16777216 0.001572 signed |
| |
| ### `xplain1.3-6base-64k-step1647` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.3-6base-64k-step1647 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.006970 signed |
| xplain1.3-6base-64k-step1647 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.006613 signed |
| xplain1.3-6base-64k-step1647 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.006396 signed |
| xplain1.3-6base-64k-step1647 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.004488 signed |
| xplain1.3-6base-64k-step1647 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.004040 signed |
| xplain1.3-6base-64k-step1647 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.003279 signed |
| xplain1.3-6base-64k-step1647 Layer 00 | input_layernorm Layer 00 input_layernorm 4096 0.002411 signed |
| xplain1.3-6base-64k-step1647 Layer 36 | input_layernorm Layer 36 input_layernorm 4096 0.002349 signed |
| xplain1.3-6base-64k-step1647 Layer 37 | input_layernorm Layer 37 input_layernorm 4096 0.002266 signed |
| xplain1.3-6base-64k-step1647 Layer 17 | input_layernorm Layer 17 input_layernorm 4096 0.002246 signed |
| xplain1.3-6base-64k-step1647 Layer 35 | input_layernorm Layer 35 input_layernorm 4096 0.002107 signed |
| xplain1.3-6base-64k-step1647 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.002046 signed |
| xplain1.3-6base-64k-step1647 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.002033 signed |
| xplain1.3-6base-64k-step1647 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.002031 signed |
| xplain1.3-6base-64k-step1647 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.001987 signed |
| xplain1.3-6base-64k-step1647 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001982 signed |
| xplain1.3-6base-64k-step1647 Layer 19 | input_layernorm Layer 19 input_layernorm 4096 0.001978 signed |
| xplain1.3-6base-64k-step1647 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001977 signed |
| xplain1.3-6base-64k-step1647 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001965 signed |
| xplain1.3-6base-64k-step1647 Layer 30 | input_layernorm Layer 30 input_layernorm 4096 0.001959 signed |
| xplain1.3-6base-64k-step1647 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.001954 signed |
| xplain1.3-6base-64k-step1647 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001919 signed |
| xplain1.3-6base-64k-step1647 Layer 31 | input_layernorm Layer 31 input_layernorm 4096 0.001907 signed |
| xplain1.3-6base-64k-step1647 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001898 signed |
| xplain1.3-6base-64k-step1647 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.001897 signed |
| xplain1.3-6base-64k-step1647 Layer 14 | input_layernorm Layer 14 input_layernorm 4096 0.001861 signed |
| xplain1.3-6base-64k-step1647 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001850 signed |
| xplain1.3-6base-64k-step1647 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001844 signed |
| xplain1.3-6base-64k-step1647 Layer 34 | mlp.down_proj Layer 34 mlp.down_proj 52428800 0.001831 signed |
| xplain1.3-6base-64k-step1647 Layer 35 | self_attn.q_proj Layer 35 self_attn.q_proj 16777216 0.001824 signed |
| xplain1.3-6base-64k-step1647 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.001822 signed |
| xplain1.3-6base-64k-step1647 Layer 36 | mlp.down_proj Layer 36 mlp.down_proj 52428800 0.001817 signed |
| xplain1.3-6base-64k-step1647 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001816 signed |
| xplain1.3-6base-64k-step1647 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.001813 signed |
| xplain1.3-6base-64k-step1647 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.001804 signed |
| xplain1.3-6base-64k-step1647 Layer 32 | input_layernorm Layer 32 input_layernorm 4096 0.001804 signed |
| xplain1.3-6base-64k-step1647 Layer 33 | input_layernorm Layer 33 input_layernorm 4096 0.001803 signed |
| xplain1.3-6base-64k-step1647 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.001798 signed |
| xplain1.3-6base-64k-step1647 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.001794 signed |
| xplain1.3-6base-64k-step1647 Layer 29 | mlp.down_proj Layer 29 mlp.down_proj 52428800 0.001790 signed |
| xplain1.3-6base-64k-step1647 Layer 31 | mlp.down_proj Layer 31 mlp.down_proj 52428800 0.001785 signed |
| xplain1.3-6base-64k-step1647 Layer 30 | mlp.down_proj Layer 30 mlp.down_proj 52428800 0.001785 signed |
| xplain1.3-6base-64k-step1647 Layer 33 | mlp.up_proj Layer 33 mlp.up_proj 52428800 0.001784 signed |
| xplain1.3-6base-64k-step1647 Layer 15 | input_layernorm Layer 15 input_layernorm 4096 0.001783 signed |
| xplain1.3-6base-64k-step1647 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.001782 signed |
| xplain1.3-6base-64k-step1647 Layer 31 | mlp.up_proj Layer 31 mlp.up_proj 52428800 0.001781 signed |
| xplain1.3-6base-64k-step1647 Layer 28 | mlp.down_proj Layer 28 mlp.down_proj 52428800 0.001779 signed |
| xplain1.3-6base-64k-step1647 Layer 28 | mlp.gate_proj Layer 28 mlp.gate_proj 52428800 0.001775 signed |
| xplain1.3-6base-64k-step1647 Layer 37 | mlp.down_proj Layer 37 mlp.down_proj 52428800 0.001774 signed |
| xplain1.3-6base-64k-step1647 Layer 27 | mlp.down_proj Layer 27 mlp.down_proj 52428800 0.001766 signed |
| |
| ### `xplain1.3-6base-8k-step2199` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.3-6base-8k-step2199 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.002092 signed |
| xplain1.3-6base-8k-step2199 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.002092 signed |
| xplain1.3-6base-8k-step2199 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.002019 signed |
| xplain1.3-6base-8k-step2199 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.001531 signed |
| xplain1.3-6base-8k-step2199 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.001351 signed |
| xplain1.3-6base-8k-step2199 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.001253 signed |
| xplain1.3-6base-8k-step2199 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.001244 signed |
| xplain1.3-6base-8k-step2199 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.001238 signed |
| xplain1.3-6base-8k-step2199 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.001196 signed |
| xplain1.3-6base-8k-step2199 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.001177 signed |
| xplain1.3-6base-8k-step2199 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001174 signed |
| xplain1.3-6base-8k-step2199 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001173 signed |
| xplain1.3-6base-8k-step2199 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001170 signed |
| xplain1.3-6base-8k-step2199 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.001120 signed |
| xplain1.3-6base-8k-step2199 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001119 signed |
| xplain1.3-6base-8k-step2199 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001116 signed |
| xplain1.3-6base-8k-step2199 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.001115 signed |
| xplain1.3-6base-8k-step2199 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001107 signed |
| xplain1.3-6base-8k-step2199 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.001101 signed |
| xplain1.3-6base-8k-step2199 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.001095 signed |
| xplain1.3-6base-8k-step2199 Layer 17 | input_layernorm Layer 17 input_layernorm 4096 0.001087 signed |
| xplain1.3-6base-8k-step2199 Layer 35 | self_attn.q_proj Layer 35 self_attn.q_proj 16777216 0.001075 signed |
| xplain1.3-6base-8k-step2199 Layer 34 | mlp.down_proj Layer 34 mlp.down_proj 52428800 0.001072 signed |
| xplain1.3-6base-8k-step2199 Layer 36 | mlp.down_proj Layer 36 mlp.down_proj 52428800 0.001070 signed |
| xplain1.3-6base-8k-step2199 Layer 37 | mlp.down_proj Layer 37 mlp.down_proj 52428800 0.001064 signed |
| xplain1.3-6base-8k-step2199 Layer 37 | self_attn.q_proj Layer 37 self_attn.q_proj 16777216 0.001064 signed |
| xplain1.3-6base-8k-step2199 Layer 38 | mlp.down_proj Layer 38 mlp.down_proj 52428800 0.001052 signed |
| xplain1.3-6base-8k-step2199 Layer 36 | self_attn.k_proj Layer 36 self_attn.k_proj 4194304 0.001038 signed |
| xplain1.3-6base-8k-step2199 Layer 35 | mlp.down_proj Layer 35 mlp.down_proj 52428800 0.001028 signed |
| xplain1.3-6base-8k-step2199 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001019 signed |
| xplain1.3-6base-8k-step2199 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001015 signed |
| xplain1.3-6base-8k-step2199 Layer 39 | mlp.up_proj Layer 39 mlp.up_proj 52428800 0.001007 signed |
| xplain1.3-6base-8k-step2199 Layer 39 | self_attn.k_proj Layer 39 self_attn.k_proj 4194304 0.001005 signed |
| xplain1.3-6base-8k-step2199 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.000999 signed |
| xplain1.3-6base-8k-step2199 Layer 35 | self_attn.k_proj Layer 35 self_attn.k_proj 4194304 0.000989 signed |
| xplain1.3-6base-8k-step2199 Layer 38 | self_attn.k_proj Layer 38 self_attn.k_proj 4194304 0.000988 signed |
| xplain1.3-6base-8k-step2199 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.000984 signed |
| xplain1.3-6base-8k-step2199 Layer 35 | input_layernorm Layer 35 input_layernorm 4096 0.000981 signed |
| xplain1.3-6base-8k-step2199 Layer 21 | self_attn.q_proj Layer 21 self_attn.q_proj 16777216 0.000980 signed |
| xplain1.3-6base-8k-step2199 Layer 17 | self_attn.q_proj Layer 17 self_attn.q_proj 16777216 0.000976 signed |
| xplain1.3-6base-8k-step2199 Layer 28 | mlp.gate_proj Layer 28 mlp.gate_proj 52428800 0.000975 signed |
| xplain1.3-6base-8k-step2199 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.000974 signed |
| xplain1.3-6base-8k-step2199 Layer 17 | mlp.gate_proj Layer 17 mlp.gate_proj 52428800 0.000974 signed |
| xplain1.3-6base-8k-step2199 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.000974 signed |
| xplain1.3-6base-8k-step2199 Layer 27 | mlp.gate_proj Layer 27 mlp.gate_proj 52428800 0.000974 signed |
| xplain1.3-6base-8k-step2199 Layer 18 | mlp.gate_proj Layer 18 mlp.gate_proj 52428800 0.000973 signed |
| xplain1.3-6base-8k-step2199 Layer 19 | self_attn.q_proj Layer 19 self_attn.q_proj 16777216 0.000971 signed |
| xplain1.3-6base-8k-step2199 Layer 19 | mlp.gate_proj Layer 19 mlp.gate_proj 52428800 0.000970 signed |
| xplain1.3-6base-8k-step2199 Layer 26 | mlp.gate_proj Layer 26 mlp.gate_proj 52428800 0.000969 signed |
| xplain1.3-6base-8k-step2199 Layer 31 | mlp.down_proj Layer 31 mlp.down_proj 52428800 0.000967 signed |
| |
| ### `xplain1.4-6base-16k-step2319` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.4-6base-16k-step2319 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.004097 signed |
| xplain1.4-6base-16k-step2319 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.004061 signed |
| xplain1.4-6base-16k-step2319 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.003967 signed |
| xplain1.4-6base-16k-step2319 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.003069 signed |
| xplain1.4-6base-16k-step2319 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.002584 signed |
| xplain1.4-6base-16k-step2319 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.002278 signed |
| xplain1.4-6base-16k-step2319 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.001990 signed |
| xplain1.4-6base-16k-step2319 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.001911 signed |
| xplain1.4-6base-16k-step2319 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.001874 signed |
| xplain1.4-6base-16k-step2319 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.001832 signed |
| xplain1.4-6base-16k-step2319 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.001829 signed |
| xplain1.4-6base-16k-step2319 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.001743 signed |
| xplain1.4-6base-16k-step2319 Layer 39 | post_attention_layernorm Layer 39 post_attention_layernorm 4096 0.001732 signed |
| xplain1.4-6base-16k-step2319 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.001715 signed |
| xplain1.4-6base-16k-step2319 Layer 38 | mlp.down_proj Layer 38 mlp.down_proj 52428800 0.001702 signed |
| xplain1.4-6base-16k-step2319 Layer 39 | mlp.up_proj Layer 39 mlp.up_proj 52428800 0.001678 signed |
| xplain1.4-6base-16k-step2319 Layer 36 | input_layernorm Layer 36 input_layernorm 4096 0.001660 signed |
| xplain1.4-6base-16k-step2319 Layer 37 | mlp.down_proj Layer 37 mlp.down_proj 52428800 0.001632 signed |
| xplain1.4-6base-16k-step2319 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.001611 signed |
| xplain1.4-6base-16k-step2319 Layer 37 | post_attention_layernorm Layer 37 post_attention_layernorm 4096 0.001591 signed |
| xplain1.4-6base-16k-step2319 Layer 37 | self_attn.q_proj Layer 37 self_attn.q_proj 16777216 0.001560 signed |
| xplain1.4-6base-16k-step2319 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001555 signed |
| xplain1.4-6base-16k-step2319 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001549 signed |
| xplain1.4-6base-16k-step2319 Layer 37 | input_layernorm Layer 37 input_layernorm 4096 0.001547 signed |
| xplain1.4-6base-16k-step2319 Layer 39 | self_attn.k_proj Layer 39 self_attn.k_proj 4194304 0.001546 signed |
| xplain1.4-6base-16k-step2319 Layer 38 | post_attention_layernorm Layer 38 post_attention_layernorm 4096 0.001541 signed |
| xplain1.4-6base-16k-step2319 Layer 38 | self_attn.k_proj Layer 38 self_attn.k_proj 4194304 0.001533 signed |
| xplain1.4-6base-16k-step2319 Layer 00 | input_layernorm Layer 00 input_layernorm 4096 0.001527 signed |
| xplain1.4-6base-16k-step2319 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001513 signed |
| xplain1.4-6base-16k-step2319 Layer 35 | input_layernorm Layer 35 input_layernorm 4096 0.001508 signed |
| xplain1.4-6base-16k-step2319 Layer 30 | input_layernorm Layer 30 input_layernorm 4096 0.001490 signed |
| xplain1.4-6base-16k-step2319 Layer 17 | input_layernorm Layer 17 input_layernorm 4096 0.001487 signed |
| xplain1.4-6base-16k-step2319 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001487 signed |
| xplain1.4-6base-16k-step2319 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001458 signed |
| xplain1.4-6base-16k-step2319 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001450 signed |
| xplain1.4-6base-16k-step2319 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001444 signed |
| xplain1.4-6base-16k-step2319 Layer 36 | mlp.down_proj Layer 36 mlp.down_proj 52428800 0.001431 signed |
| xplain1.4-6base-16k-step2319 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001430 signed |
| xplain1.4-6base-16k-step2319 Layer 39 | input_layernorm Layer 39 input_layernorm 4096 0.001430 signed |
| xplain1.4-6base-16k-step2319 Layer 31 | input_layernorm Layer 31 input_layernorm 4096 0.001421 signed |
| xplain1.4-6base-16k-step2319 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.001418 signed |
| xplain1.4-6base-16k-step2319 Layer 37 | self_attn.k_proj Layer 37 self_attn.k_proj 4194304 0.001413 signed |
| xplain1.4-6base-16k-step2319 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.001409 signed |
| xplain1.4-6base-16k-step2319 Layer 33 | mlp.up_proj Layer 33 mlp.up_proj 52428800 0.001392 signed |
| xplain1.4-6base-16k-step2319 Layer 34 | mlp.down_proj Layer 34 mlp.down_proj 52428800 0.001389 signed |
| xplain1.4-6base-16k-step2319 Layer 35 | self_attn.q_proj Layer 35 self_attn.q_proj 16777216 0.001387 signed |
| xplain1.4-6base-16k-step2319 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.001387 signed |
| xplain1.4-6base-16k-step2319 Layer 35 | mlp.down_proj Layer 35 mlp.down_proj 52428800 0.001381 signed |
| xplain1.4-6base-16k-step2319 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.001380 signed |
| xplain1.4-6base-16k-step2319 Layer 31 | mlp.down_proj Layer 31 mlp.down_proj 52428800 0.001379 signed |
| |
| ### `xplain1.4-6base-32k-step1743` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.4-6base-32k-step1743 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.005665 signed |
| xplain1.4-6base-32k-step1743 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.005453 signed |
| xplain1.4-6base-32k-step1743 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.005436 signed |
| xplain1.4-6base-32k-step1743 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.004031 signed |
| xplain1.4-6base-32k-step1743 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.003478 signed |
| xplain1.4-6base-32k-step1743 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.002953 signed |
| xplain1.4-6base-32k-step1743 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.002214 signed |
| xplain1.4-6base-32k-step1743 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.002141 signed |
| xplain1.4-6base-32k-step1743 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.002105 signed |
| xplain1.4-6base-32k-step1743 Layer 36 | input_layernorm Layer 36 input_layernorm 4096 0.002073 signed |
| xplain1.4-6base-32k-step1743 Layer 00 | input_layernorm Layer 00 input_layernorm 4096 0.002072 signed |
| xplain1.4-6base-32k-step1743 Layer 39 | post_attention_layernorm Layer 39 post_attention_layernorm 4096 0.002072 signed |
| xplain1.4-6base-32k-step1743 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.002064 signed |
| xplain1.4-6base-32k-step1743 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.002055 signed |
| xplain1.4-6base-32k-step1743 Layer 37 | input_layernorm Layer 37 input_layernorm 4096 0.002037 signed |
| xplain1.4-6base-32k-step1743 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.001931 signed |
| xplain1.4-6base-32k-step1743 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.001905 signed |
| xplain1.4-6base-32k-step1743 Layer 39 | mlp.up_proj Layer 39 mlp.up_proj 52428800 0.001901 signed |
| xplain1.4-6base-32k-step1743 Layer 38 | mlp.down_proj Layer 38 mlp.down_proj 52428800 0.001889 signed |
| xplain1.4-6base-32k-step1743 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.001865 signed |
| xplain1.4-6base-32k-step1743 Layer 17 | input_layernorm Layer 17 input_layernorm 4096 0.001864 signed |
| xplain1.4-6base-32k-step1743 Layer 37 | post_attention_layernorm Layer 37 post_attention_layernorm 4096 0.001838 signed |
| xplain1.4-6base-32k-step1743 Layer 35 | input_layernorm Layer 35 input_layernorm 4096 0.001836 signed |
| xplain1.4-6base-32k-step1743 Layer 37 | mlp.down_proj Layer 37 mlp.down_proj 52428800 0.001827 signed |
| xplain1.4-6base-32k-step1743 Layer 30 | input_layernorm Layer 30 input_layernorm 4096 0.001813 signed |
| xplain1.4-6base-32k-step1743 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001812 signed |
| xplain1.4-6base-32k-step1743 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001800 signed |
| xplain1.4-6base-32k-step1743 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001769 signed |
| xplain1.4-6base-32k-step1743 Layer 37 | self_attn.q_proj Layer 37 self_attn.q_proj 16777216 0.001763 signed |
| xplain1.4-6base-32k-step1743 Layer 38 | post_attention_layernorm Layer 38 post_attention_layernorm 4096 0.001744 signed |
| xplain1.4-6base-32k-step1743 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001735 signed |
| xplain1.4-6base-32k-step1743 Layer 39 | input_layernorm Layer 39 input_layernorm 4096 0.001728 signed |
| xplain1.4-6base-32k-step1743 Layer 31 | input_layernorm Layer 31 input_layernorm 4096 0.001726 signed |
| xplain1.4-6base-32k-step1743 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001711 signed |
| xplain1.4-6base-32k-step1743 Layer 39 | self_attn.k_proj Layer 39 self_attn.k_proj 4194304 0.001703 signed |
| xplain1.4-6base-32k-step1743 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001699 signed |
| xplain1.4-6base-32k-step1743 Layer 38 | self_attn.k_proj Layer 38 self_attn.k_proj 4194304 0.001686 signed |
| xplain1.4-6base-32k-step1743 Layer 19 | input_layernorm Layer 19 input_layernorm 4096 0.001684 signed |
| xplain1.4-6base-32k-step1743 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001682 signed |
| xplain1.4-6base-32k-step1743 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.001675 signed |
| xplain1.4-6base-32k-step1743 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001671 signed |
| xplain1.4-6base-32k-step1743 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.001668 signed |
| xplain1.4-6base-32k-step1743 Layer 36 | mlp.down_proj Layer 36 mlp.down_proj 52428800 0.001652 signed |
| xplain1.4-6base-32k-step1743 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.001644 signed |
| xplain1.4-6base-32k-step1743 Layer 33 | mlp.up_proj Layer 33 mlp.up_proj 52428800 0.001643 signed |
| xplain1.4-6base-32k-step1743 Layer 32 | input_layernorm Layer 32 input_layernorm 4096 0.001638 signed |
| xplain1.4-6base-32k-step1743 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.001634 signed |
| xplain1.4-6base-32k-step1743 Layer 31 | mlp.up_proj Layer 31 mlp.up_proj 52428800 0.001630 signed |
| xplain1.4-6base-32k-step1743 Layer 35 | self_attn.q_proj Layer 35 self_attn.q_proj 16777216 0.001630 signed |
| xplain1.4-6base-32k-step1743 Layer 29 | mlp.down_proj Layer 29 mlp.down_proj 52428800 0.001628 signed |
| |
| ### `xplain1.4-6base-64k-step1743` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.4-6base-64k-step1743 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.007021 signed |
| xplain1.4-6base-64k-step1743 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.006637 signed |
| xplain1.4-6base-64k-step1743 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.006622 signed |
| xplain1.4-6base-64k-step1743 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.004975 signed |
| xplain1.4-6base-64k-step1743 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.004198 signed |
| xplain1.4-6base-64k-step1743 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.003582 signed |
| xplain1.4-6base-64k-step1743 Layer 37 | input_layernorm Layer 37 input_layernorm 4096 0.002491 signed |
| xplain1.4-6base-64k-step1743 Layer 36 | input_layernorm Layer 36 input_layernorm 4096 0.002454 signed |
| xplain1.4-6base-64k-step1743 Layer 00 | input_layernorm Layer 00 input_layernorm 4096 0.002429 signed |
| xplain1.4-6base-64k-step1743 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.002357 signed |
| xplain1.4-6base-64k-step1743 Layer 39 | post_attention_layernorm Layer 39 post_attention_layernorm 4096 0.002316 signed |
| xplain1.4-6base-64k-step1743 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.002259 signed |
| xplain1.4-6base-64k-step1743 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.002255 signed |
| xplain1.4-6base-64k-step1743 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.002206 signed |
| xplain1.4-6base-64k-step1743 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.002186 signed |
| xplain1.4-6base-64k-step1743 Layer 17 | input_layernorm Layer 17 input_layernorm 4096 0.002164 signed |
| xplain1.4-6base-64k-step1743 Layer 35 | input_layernorm Layer 35 input_layernorm 4096 0.002126 signed |
| xplain1.4-6base-64k-step1743 Layer 39 | mlp.up_proj Layer 39 mlp.up_proj 52428800 0.002050 signed |
| xplain1.4-6base-64k-step1743 Layer 30 | input_layernorm Layer 30 input_layernorm 4096 0.002045 signed |
| xplain1.4-6base-64k-step1743 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.002030 signed |
| xplain1.4-6base-64k-step1743 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.002021 signed |
| xplain1.4-6base-64k-step1743 Layer 38 | mlp.down_proj Layer 38 mlp.down_proj 52428800 0.002011 signed |
| xplain1.4-6base-64k-step1743 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.001999 signed |
| xplain1.4-6base-64k-step1743 Layer 19 | input_layernorm Layer 19 input_layernorm 4096 0.001980 signed |
| xplain1.4-6base-64k-step1743 Layer 39 | input_layernorm Layer 39 input_layernorm 4096 0.001972 signed |
| xplain1.4-6base-64k-step1743 Layer 31 | input_layernorm Layer 31 input_layernorm 4096 0.001948 signed |
| xplain1.4-6base-64k-step1743 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001947 signed |
| xplain1.4-6base-64k-step1743 Layer 37 | post_attention_layernorm Layer 37 post_attention_layernorm 4096 0.001946 signed |
| xplain1.4-6base-64k-step1743 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001936 signed |
| xplain1.4-6base-64k-step1743 Layer 37 | mlp.down_proj Layer 37 mlp.down_proj 52428800 0.001930 signed |
| xplain1.4-6base-64k-step1743 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001911 signed |
| xplain1.4-6base-64k-step1743 Layer 33 | input_layernorm Layer 33 input_layernorm 4096 0.001875 signed |
| xplain1.4-6base-64k-step1743 Layer 38 | post_attention_layernorm Layer 38 post_attention_layernorm 4096 0.001872 signed |
| xplain1.4-6base-64k-step1743 Layer 37 | self_attn.q_proj Layer 37 self_attn.q_proj 16777216 0.001868 signed |
| xplain1.4-6base-64k-step1743 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001866 signed |
| xplain1.4-6base-64k-step1743 Layer 14 | input_layernorm Layer 14 input_layernorm 4096 0.001866 signed |
| xplain1.4-6base-64k-step1743 Layer 32 | input_layernorm Layer 32 input_layernorm 4096 0.001862 signed |
| xplain1.4-6base-64k-step1743 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001846 signed |
| xplain1.4-6base-64k-step1743 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001843 signed |
| xplain1.4-6base-64k-step1743 Layer 15 | input_layernorm Layer 15 input_layernorm 4096 0.001836 signed |
| xplain1.4-6base-64k-step1743 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.001823 signed |
| xplain1.4-6base-64k-step1743 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.001822 signed |
| xplain1.4-6base-64k-step1743 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001816 signed |
| xplain1.4-6base-64k-step1743 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001804 signed |
| xplain1.4-6base-64k-step1743 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.001799 signed |
| xplain1.4-6base-64k-step1743 Layer 39 | self_attn.k_proj Layer 39 self_attn.k_proj 4194304 0.001799 signed |
| xplain1.4-6base-64k-step1743 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.001790 signed |
| xplain1.4-6base-64k-step1743 Layer 28 | mlp.gate_proj Layer 28 mlp.gate_proj 52428800 0.001780 signed |
| xplain1.4-6base-64k-step1743 Layer 33 | mlp.up_proj Layer 33 mlp.up_proj 52428800 0.001778 signed |
| xplain1.4-6base-64k-step1743 Layer 31 | mlp.up_proj Layer 31 mlp.up_proj 52428800 0.001776 signed |
| |
| ### `xplain1.4-6base-8k-step2319` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.4-6base-8k-step2319 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.002199 signed |
| xplain1.4-6base-8k-step2319 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.002092 signed |
| xplain1.4-6base-8k-step2319 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.002085 signed |
| xplain1.4-6base-8k-step2319 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.001681 signed |
| xplain1.4-6base-8k-step2319 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.001586 signed |
| xplain1.4-6base-8k-step2319 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.001515 signed |
| xplain1.4-6base-8k-step2319 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.001469 signed |
| xplain1.4-6base-8k-step2319 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.001428 signed |
| xplain1.4-6base-8k-step2319 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.001405 signed |
| xplain1.4-6base-8k-step2319 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.001402 signed |
| xplain1.4-6base-8k-step2319 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.001373 signed |
| xplain1.4-6base-8k-step2319 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.001353 signed |
| xplain1.4-6base-8k-step2319 Layer 38 | mlp.down_proj Layer 38 mlp.down_proj 52428800 0.001327 signed |
| xplain1.4-6base-8k-step2319 Layer 37 | mlp.down_proj Layer 37 mlp.down_proj 52428800 0.001265 signed |
| xplain1.4-6base-8k-step2319 Layer 39 | mlp.up_proj Layer 39 mlp.up_proj 52428800 0.001259 signed |
| xplain1.4-6base-8k-step2319 Layer 38 | self_attn.k_proj Layer 38 self_attn.k_proj 4194304 0.001250 signed |
| xplain1.4-6base-8k-step2319 Layer 39 | self_attn.k_proj Layer 39 self_attn.k_proj 4194304 0.001244 signed |
| xplain1.4-6base-8k-step2319 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.001241 signed |
| xplain1.4-6base-8k-step2319 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.001226 signed |
| xplain1.4-6base-8k-step2319 Layer 37 | self_attn.q_proj Layer 37 self_attn.q_proj 16777216 0.001212 signed |
| xplain1.4-6base-8k-step2319 Layer 38 | post_attention_layernorm Layer 38 post_attention_layernorm 4096 0.001187 signed |
| xplain1.4-6base-8k-step2319 Layer 37 | post_attention_layernorm Layer 37 post_attention_layernorm 4096 0.001183 signed |
| xplain1.4-6base-8k-step2319 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001175 signed |
| xplain1.4-6base-8k-step2319 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001160 signed |
| xplain1.4-6base-8k-step2319 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001139 signed |
| xplain1.4-6base-8k-step2319 Layer 23 | input_layernorm Layer 23 input_layernorm 4096 0.001125 signed |
| xplain1.4-6base-8k-step2319 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001116 signed |
| xplain1.4-6base-8k-step2319 Layer 37 | self_attn.k_proj Layer 37 self_attn.k_proj 4194304 0.001100 signed |
| xplain1.4-6base-8k-step2319 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001088 signed |
| xplain1.4-6base-8k-step2319 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001080 signed |
| xplain1.4-6base-8k-step2319 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001072 signed |
| xplain1.4-6base-8k-step2319 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001070 signed |
| xplain1.4-6base-8k-step2319 Layer 26 | input_layernorm Layer 26 input_layernorm 4096 0.001063 signed |
| xplain1.4-6base-8k-step2319 Layer 36 | mlp.down_proj Layer 36 mlp.down_proj 52428800 0.001055 signed |
| xplain1.4-6base-8k-step2319 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.001048 signed |
| xplain1.4-6base-8k-step2319 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.001041 signed |
| xplain1.4-6base-8k-step2319 Layer 18 | mlp.gate_proj Layer 18 mlp.gate_proj 52428800 0.001035 signed |
| xplain1.4-6base-8k-step2319 Layer 19 | mlp.gate_proj Layer 19 mlp.gate_proj 52428800 0.001032 signed |
| xplain1.4-6base-8k-step2319 Layer 33 | mlp.up_proj Layer 33 mlp.up_proj 52428800 0.001030 signed |
| xplain1.4-6base-8k-step2319 Layer 34 | mlp.down_proj Layer 34 mlp.down_proj 52428800 0.001028 signed |
| xplain1.4-6base-8k-step2319 Layer 17 | mlp.gate_proj Layer 17 mlp.gate_proj 52428800 0.001027 signed |
| xplain1.4-6base-8k-step2319 Layer 39 | post_attention_layernorm Layer 39 post_attention_layernorm 4096 0.001026 signed |
| xplain1.4-6base-8k-step2319 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.001026 signed |
| xplain1.4-6base-8k-step2319 Layer 35 | mlp.down_proj Layer 35 mlp.down_proj 52428800 0.001025 signed |
| xplain1.4-6base-8k-step2319 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.001024 signed |
| xplain1.4-6base-8k-step2319 Layer 28 | mlp.gate_proj Layer 28 mlp.gate_proj 52428800 0.001023 signed |
| xplain1.4-6base-8k-step2319 Layer 27 | mlp.gate_proj Layer 27 mlp.gate_proj 52428800 0.001022 signed |
| xplain1.4-6base-8k-step2319 Layer 35 | self_attn.q_proj Layer 35 self_attn.q_proj 16777216 0.001021 signed |
| xplain1.4-6base-8k-step2319 Layer 25 | mlp.gate_proj Layer 25 mlp.gate_proj 52428800 0.001020 signed |
| xplain1.4-6base-8k-step2319 Layer 26 | mlp.gate_proj Layer 26 mlp.gate_proj 52428800 0.001019 signed |
| |
| ### `xplain1.4-7base-32k-step1743` |
|
|
| model sublayer block_label module_type count std stat_mode |
| xplain1.4-7base-32k-step1743 Layer 22 | input_layernorm Layer 22 input_layernorm 4096 0.004702 signed |
| xplain1.4-7base-32k-step1743 Layer 28 | input_layernorm Layer 28 input_layernorm 4096 0.004587 signed |
| xplain1.4-7base-32k-step1743 Layer 25 | input_layernorm Layer 25 input_layernorm 4096 0.004584 signed |
| xplain1.4-7base-32k-step1743 Layer 18 | input_layernorm Layer 18 input_layernorm 4096 0.004540 signed |
| xplain1.4-7base-32k-step1743 Layer 21 | input_layernorm Layer 21 input_layernorm 4096 0.002993 signed |
| xplain1.4-7base-32k-step1743 Layer 38 | input_layernorm Layer 38 input_layernorm 4096 0.002686 signed |
| xplain1.4-7base-32k-step1743 Layer 17 | input_layernorm Layer 17 input_layernorm 4096 0.002019 signed |
| xplain1.4-7base-32k-step1743 Layer 36 | input_layernorm Layer 36 input_layernorm 4096 0.001978 signed |
| xplain1.4-7base-32k-step1743 Layer 37 | input_layernorm Layer 37 input_layernorm 4096 0.001967 signed |
| xplain1.4-7base-32k-step1743 Layer 16 | input_layernorm Layer 16 input_layernorm 4096 0.001832 signed |
| xplain1.4-7base-32k-step1743 Layer 14 | input_layernorm Layer 14 input_layernorm 4096 0.001804 signed |
| xplain1.4-7base-32k-step1743 Layer 15 | input_layernorm Layer 15 input_layernorm 4096 0.001766 signed |
| xplain1.4-7base-32k-step1743 Layer 38 | mlp.gate_proj Layer 38 mlp.gate_proj 52428800 0.001752 signed |
| xplain1.4-7base-32k-step1743 Layer 37 | mlp.gate_proj Layer 37 mlp.gate_proj 52428800 0.001746 signed |
| xplain1.4-7base-32k-step1743 Layer 36 | mlp.gate_proj Layer 36 mlp.gate_proj 52428800 0.001724 signed |
| xplain1.4-7base-32k-step1743 Layer 37 | mlp.up_proj Layer 37 mlp.up_proj 52428800 0.001685 signed |
| xplain1.4-7base-32k-step1743 Layer 38 | mlp.up_proj Layer 38 mlp.up_proj 52428800 0.001680 signed |
| xplain1.4-7base-32k-step1743 Layer 36 | mlp.up_proj Layer 36 mlp.up_proj 52428800 0.001668 signed |
| xplain1.4-7base-32k-step1743 Layer 39 | post_attention_layernorm Layer 39 post_attention_layernorm 4096 0.001665 signed |
| xplain1.4-7base-32k-step1743 Layer 39 | mlp.gate_proj Layer 39 mlp.gate_proj 52428800 0.001665 signed |
| xplain1.4-7base-32k-step1743 Layer 35 | mlp.gate_proj Layer 35 mlp.gate_proj 52428800 0.001662 signed |
| xplain1.4-7base-32k-step1743 Layer 34 | mlp.gate_proj Layer 34 mlp.gate_proj 52428800 0.001657 signed |
| xplain1.4-7base-32k-step1743 Layer 19 | input_layernorm Layer 19 input_layernorm 4096 0.001644 signed |
| xplain1.4-7base-32k-step1743 Layer 13 | input_layernorm Layer 13 input_layernorm 4096 0.001611 signed |
| xplain1.4-7base-32k-step1743 Layer 00 | input_layernorm Layer 00 input_layernorm 4096 0.001606 signed |
| xplain1.4-7base-32k-step1743 Layer 35 | mlp.up_proj Layer 35 mlp.up_proj 52428800 0.001599 signed |
| xplain1.4-7base-32k-step1743 Layer 34 | mlp.up_proj Layer 34 mlp.up_proj 52428800 0.001599 signed |
| xplain1.4-7base-32k-step1743 Layer 33 | mlp.gate_proj Layer 33 mlp.gate_proj 52428800 0.001592 signed |
| xplain1.4-7base-32k-step1743 Layer 34 | self_attn.q_proj Layer 34 self_attn.q_proj 16777216 0.001577 signed |
| xplain1.4-7base-32k-step1743 Layer 36 | self_attn.q_proj Layer 36 self_attn.q_proj 16777216 0.001575 signed |
| xplain1.4-7base-32k-step1743 Layer 32 | mlp.gate_proj Layer 32 mlp.gate_proj 52428800 0.001565 signed |
| xplain1.4-7base-32k-step1743 Layer 31 | mlp.gate_proj Layer 31 mlp.gate_proj 52428800 0.001558 signed |
| xplain1.4-7base-32k-step1743 Layer 35 | self_attn.q_proj Layer 35 self_attn.q_proj 16777216 0.001557 signed |
| xplain1.4-7base-32k-step1743 Layer 38 | self_attn.q_proj Layer 38 self_attn.q_proj 16777216 0.001556 signed |
| xplain1.4-7base-32k-step1743 Layer 39 | mlp.up_proj Layer 39 mlp.up_proj 52428800 0.001542 signed |
| xplain1.4-7base-32k-step1743 Layer 30 | input_layernorm Layer 30 input_layernorm 4096 0.001540 signed |
| xplain1.4-7base-32k-step1743 Layer 30 | mlp.gate_proj Layer 30 mlp.gate_proj 52428800 0.001533 signed |
| xplain1.4-7base-32k-step1743 Layer 33 | mlp.up_proj Layer 33 mlp.up_proj 52428800 0.001533 signed |
| xplain1.4-7base-32k-step1743 Layer 31 | mlp.down_proj Layer 31 mlp.down_proj 52428800 0.001528 signed |
| xplain1.4-7base-32k-step1743 Layer 30 | mlp.down_proj Layer 30 mlp.down_proj 52428800 0.001525 signed |
| xplain1.4-7base-32k-step1743 Layer 35 | input_layernorm Layer 35 input_layernorm 4096 0.001522 signed |
| xplain1.4-7base-32k-step1743 Layer 29 | mlp.down_proj Layer 29 mlp.down_proj 52428800 0.001521 signed |
| xplain1.4-7base-32k-step1743 Layer 31 | mlp.up_proj Layer 31 mlp.up_proj 52428800 0.001520 signed |
| xplain1.4-7base-32k-step1743 Layer 29 | mlp.gate_proj Layer 29 mlp.gate_proj 52428800 0.001518 signed |
| xplain1.4-7base-32k-step1743 Layer 39 | self_attn.q_proj Layer 39 self_attn.q_proj 16777216 0.001518 signed |
| xplain1.4-7base-32k-step1743 Layer 34 | mlp.down_proj Layer 34 mlp.down_proj 52428800 0.001517 signed |
| xplain1.4-7base-32k-step1743 Layer 32 | mlp.up_proj Layer 32 mlp.up_proj 52428800 0.001515 signed |
| xplain1.4-7base-32k-step1743 Layer 37 | self_attn.q_proj Layer 37 self_attn.q_proj 16777216 0.001511 signed |
| xplain1.4-7base-32k-step1743 Layer 28 | mlp.gate_proj Layer 28 mlp.gate_proj 52428800 0.001510 signed |
| xplain1.4-7base-32k-step1743 Layer 36 | mlp.down_proj Layer 36 mlp.down_proj 52428800 0.001509 signed |
| |
| ## Top layers or global blocks by std |
|
|
| ### `xplain1.3-6base-16k-step2199` |
|
|
| model block_label count std stat_mode |
| xplain1.3-6base-16k-step2199 Layer 36 199237632 0.001477 signed |
| xplain1.3-6base-16k-step2199 Layer 37 199237632 0.001473 signed |
| xplain1.3-6base-16k-step2199 Layer 38 199237632 0.001456 signed |
| xplain1.3-6base-16k-step2199 Layer 34 199237632 0.001435 signed |
| xplain1.3-6base-16k-step2199 Layer 35 199237632 0.001420 signed |
| xplain1.3-6base-16k-step2199 Layer 31 199237632 0.001318 signed |
| xplain1.3-6base-16k-step2199 Layer 33 199237632 0.001307 signed |
| xplain1.3-6base-16k-step2199 Layer 30 199237632 0.001303 signed |
| xplain1.3-6base-16k-step2199 Layer 32 199237632 0.001296 signed |
| xplain1.3-6base-16k-step2199 Layer 28 199237632 0.001292 signed |
| xplain1.3-6base-16k-step2199 Layer 25 199237632 0.001272 signed |
| xplain1.3-6base-16k-step2199 Layer 39 199237632 0.001269 signed |
| xplain1.3-6base-16k-step2199 Layer 22 199237632 0.001259 signed |
| xplain1.3-6base-16k-step2199 Layer 21 199237632 0.001256 signed |
| xplain1.3-6base-16k-step2199 Layer 19 199237632 0.001233 signed |
| xplain1.3-6base-16k-step2199 Layer 29 199237632 0.001223 signed |
| xplain1.3-6base-16k-step2199 Layer 18 199237632 0.001220 signed |
| xplain1.3-6base-16k-step2199 Layer 27 199237632 0.001213 signed |
| xplain1.3-6base-16k-step2199 Layer 17 199237632 0.001212 signed |
| xplain1.3-6base-16k-step2199 Layer 26 199237632 0.001204 signed |
| xplain1.3-6base-16k-step2199 Layer 16 199237632 0.001190 signed |
| xplain1.3-6base-16k-step2199 Layer 24 199237632 0.001186 signed |
| xplain1.3-6base-16k-step2199 Layer 15 199237632 0.001182 signed |
| xplain1.3-6base-16k-step2199 Layer 23 199237632 0.001177 signed |
| xplain1.3-6base-16k-step2199 Layer 20 199237632 0.001158 signed |
| xplain1.3-6base-16k-step2199 Layer 14 199237632 0.001155 signed |
| xplain1.3-6base-16k-step2199 Layer 13 199237632 0.001132 signed |
| xplain1.3-6base-16k-step2199 Layer 12 199237632 0.001125 signed |
| xplain1.3-6base-16k-step2199 Layer 11 199237632 0.001106 signed |
| xplain1.3-6base-16k-step2199 Layer 10 199237632 0.001089 signed |
| xplain1.3-6base-16k-step2199 Layer 09 199237632 0.001072 signed |
| xplain1.3-6base-16k-step2199 Layer 08 199237632 0.001057 signed |
| xplain1.3-6base-16k-step2199 Layer 06 199237632 0.001048 signed |
| xplain1.3-6base-16k-step2199 Layer 07 199237632 0.001047 signed |
| xplain1.3-6base-16k-step2199 Layer 05 199237632 0.001040 signed |
| xplain1.3-6base-16k-step2199 Layer 00 199237632 0.001025 signed |
| xplain1.3-6base-16k-step2199 Layer 04 199237632 0.001025 signed |
| xplain1.3-6base-16k-step2199 Layer 01 199237632 0.001012 signed |
| xplain1.3-6base-16k-step2199 Layer 03 199237632 0.000982 signed |
| xplain1.3-6base-16k-step2199 Layer 02 199237632 0.000980 signed |
| |
| ### `xplain1.3-6base-32k-step1647` |
|
|
| model block_label count std stat_mode |
| xplain1.3-6base-32k-step1647 Layer 36 199237632 0.001691 signed |
| xplain1.3-6base-32k-step1647 Layer 37 199237632 0.001681 signed |
| xplain1.3-6base-32k-step1647 Layer 38 199237632 0.001660 signed |
| xplain1.3-6base-32k-step1647 Layer 34 199237632 0.001654 signed |
| xplain1.3-6base-32k-step1647 Layer 35 199237632 0.001632 signed |
| xplain1.3-6base-32k-step1647 Layer 31 199237632 0.001549 signed |
| xplain1.3-6base-32k-step1647 Layer 30 199237632 0.001533 signed |
| xplain1.3-6base-32k-step1647 Layer 33 199237632 0.001532 signed |
| xplain1.3-6base-32k-step1647 Layer 32 199237632 0.001524 signed |
| xplain1.3-6base-32k-step1647 Layer 28 199237632 0.001520 signed |
| xplain1.3-6base-32k-step1647 Layer 25 199237632 0.001491 signed |
| xplain1.3-6base-32k-step1647 Layer 22 199237632 0.001467 signed |
| xplain1.3-6base-32k-step1647 Layer 39 199237632 0.001464 signed |
| xplain1.3-6base-32k-step1647 Layer 21 199237632 0.001460 signed |
| xplain1.3-6base-32k-step1647 Layer 29 199237632 0.001432 signed |
| xplain1.3-6base-32k-step1647 Layer 19 199237632 0.001427 signed |
| xplain1.3-6base-32k-step1647 Layer 27 199237632 0.001417 signed |
| xplain1.3-6base-32k-step1647 Layer 18 199237632 0.001410 signed |
| xplain1.3-6base-32k-step1647 Layer 26 199237632 0.001406 signed |
| xplain1.3-6base-32k-step1647 Layer 17 199237632 0.001398 signed |
| xplain1.3-6base-32k-step1647 Layer 24 199237632 0.001384 signed |
| xplain1.3-6base-32k-step1647 Layer 16 199237632 0.001372 signed |
| xplain1.3-6base-32k-step1647 Layer 23 199237632 0.001371 signed |
| xplain1.3-6base-32k-step1647 Layer 15 199237632 0.001361 signed |
| xplain1.3-6base-32k-step1647 Layer 20 199237632 0.001342 signed |
| xplain1.3-6base-32k-step1647 Layer 14 199237632 0.001329 signed |
| xplain1.3-6base-32k-step1647 Layer 13 199237632 0.001302 signed |
| xplain1.3-6base-32k-step1647 Layer 12 199237632 0.001293 signed |
| xplain1.3-6base-32k-step1647 Layer 11 199237632 0.001271 signed |
| xplain1.3-6base-32k-step1647 Layer 10 199237632 0.001250 signed |
| xplain1.3-6base-32k-step1647 Layer 09 199237632 0.001230 signed |
| xplain1.3-6base-32k-step1647 Layer 08 199237632 0.001212 signed |
| xplain1.3-6base-32k-step1647 Layer 07 199237632 0.001192 signed |
| xplain1.3-6base-32k-step1647 Layer 06 199237632 0.001188 signed |
| xplain1.3-6base-32k-step1647 Layer 05 199237632 0.001171 signed |
| xplain1.3-6base-32k-step1647 Layer 04 199237632 0.001147 signed |
| xplain1.3-6base-32k-step1647 Layer 00 199237632 0.001121 signed |
| xplain1.3-6base-32k-step1647 Layer 01 199237632 0.001114 signed |
| xplain1.3-6base-32k-step1647 Layer 03 199237632 0.001100 signed |
| xplain1.3-6base-32k-step1647 Layer 02 199237632 0.001088 signed |
| |
| ### `xplain1.3-6base-64k-step1647` |
|
|
| model block_label count std stat_mode |
| xplain1.3-6base-64k-step1647 Layer 36 199237632 0.001877 signed |
| xplain1.3-6base-64k-step1647 Layer 37 199237632 0.001862 signed |
| xplain1.3-6base-64k-step1647 Layer 34 199237632 0.001847 signed |
| xplain1.3-6base-64k-step1647 Layer 38 199237632 0.001836 signed |
| xplain1.3-6base-64k-step1647 Layer 35 199237632 0.001819 signed |
| xplain1.3-6base-64k-step1647 Layer 31 199237632 0.001748 signed |
| xplain1.3-6base-64k-step1647 Layer 30 199237632 0.001732 signed |
| xplain1.3-6base-64k-step1647 Layer 33 199237632 0.001730 signed |
| xplain1.3-6base-64k-step1647 Layer 32 199237632 0.001722 signed |
| xplain1.3-6base-64k-step1647 Layer 28 199237632 0.001717 signed |
| xplain1.3-6base-64k-step1647 Layer 25 199237632 0.001685 signed |
| xplain1.3-6base-64k-step1647 Layer 22 199237632 0.001650 signed |
| xplain1.3-6base-64k-step1647 Layer 21 199237632 0.001639 signed |
| xplain1.3-6base-64k-step1647 Layer 39 199237632 0.001636 signed |
| xplain1.3-6base-64k-step1647 Layer 29 199237632 0.001614 signed |
| xplain1.3-6base-64k-step1647 Layer 19 199237632 0.001598 signed |
| xplain1.3-6base-64k-step1647 Layer 27 199237632 0.001595 signed |
| xplain1.3-6base-64k-step1647 Layer 26 199237632 0.001583 signed |
| xplain1.3-6base-64k-step1647 Layer 18 199237632 0.001580 signed |
| xplain1.3-6base-64k-step1647 Layer 17 199237632 0.001566 signed |
| xplain1.3-6base-64k-step1647 Layer 24 199237632 0.001556 signed |
| xplain1.3-6base-64k-step1647 Layer 23 199237632 0.001542 signed |
| xplain1.3-6base-64k-step1647 Layer 16 199237632 0.001539 signed |
| xplain1.3-6base-64k-step1647 Layer 15 199237632 0.001527 signed |
| xplain1.3-6base-64k-step1647 Layer 20 199237632 0.001506 signed |
| xplain1.3-6base-64k-step1647 Layer 14 199237632 0.001493 signed |
| xplain1.3-6base-64k-step1647 Layer 13 199237632 0.001467 signed |
| xplain1.3-6base-64k-step1647 Layer 12 199237632 0.001456 signed |
| xplain1.3-6base-64k-step1647 Layer 11 199237632 0.001433 signed |
| xplain1.3-6base-64k-step1647 Layer 10 199237632 0.001413 signed |
| xplain1.3-6base-64k-step1647 Layer 09 199237632 0.001394 signed |
| xplain1.3-6base-64k-step1647 Layer 08 199237632 0.001377 signed |
| xplain1.3-6base-64k-step1647 Layer 00 199237632 0.001373 signed |
| xplain1.3-6base-64k-step1647 Layer 01 199237632 0.001365 signed |
| xplain1.3-6base-64k-step1647 Layer 07 199237632 0.001354 signed |
| xplain1.3-6base-64k-step1647 Layer 06 199237632 0.001354 signed |
| xplain1.3-6base-64k-step1647 Layer 04 199237632 0.001353 signed |
| xplain1.3-6base-64k-step1647 Layer 05 199237632 0.001339 signed |
| xplain1.3-6base-64k-step1647 Layer 02 199237632 0.001336 signed |
| xplain1.3-6base-64k-step1647 Layer 03 199237632 0.001333 signed |
| |
| ### `xplain1.3-6base-8k-step2199` |
|
|
| model block_label count std stat_mode |
| xplain1.3-6base-8k-step2199 Layer 37 199237632 0.001120 signed |
| xplain1.3-6base-8k-step2199 Layer 36 199237632 0.001117 signed |
| xplain1.3-6base-8k-step2199 Layer 38 199237632 0.001110 signed |
| xplain1.3-6base-8k-step2199 Layer 34 199237632 0.001072 signed |
| xplain1.3-6base-8k-step2199 Layer 35 199237632 0.001063 signed |
| xplain1.3-6base-8k-step2199 Layer 39 199237632 0.000948 signed |
| xplain1.3-6base-8k-step2199 Layer 31 199237632 0.000937 signed |
| xplain1.3-6base-8k-step2199 Layer 33 199237632 0.000935 signed |
| xplain1.3-6base-8k-step2199 Layer 30 199237632 0.000921 signed |
| xplain1.3-6base-8k-step2199 Layer 32 199237632 0.000918 signed |
| xplain1.3-6base-8k-step2199 Layer 28 199237632 0.000914 signed |
| xplain1.3-6base-8k-step2199 Layer 21 199237632 0.000904 signed |
| xplain1.3-6base-8k-step2199 Layer 22 199237632 0.000904 signed |
| xplain1.3-6base-8k-step2199 Layer 25 199237632 0.000902 signed |
| xplain1.3-6base-8k-step2199 Layer 19 199237632 0.000894 signed |
| xplain1.3-6base-8k-step2199 Layer 18 199237632 0.000884 signed |
| xplain1.3-6base-8k-step2199 Layer 17 199237632 0.000881 signed |
| xplain1.3-6base-8k-step2199 Layer 29 199237632 0.000868 signed |
| xplain1.3-6base-8k-step2199 Layer 27 199237632 0.000862 signed |
| xplain1.3-6base-8k-step2199 Layer 16 199237632 0.000860 signed |
| xplain1.3-6base-8k-step2199 Layer 26 199237632 0.000857 signed |
| xplain1.3-6base-8k-step2199 Layer 15 199237632 0.000855 signed |
| xplain1.3-6base-8k-step2199 Layer 24 199237632 0.000845 signed |
| xplain1.3-6base-8k-step2199 Layer 23 199237632 0.000838 signed |
| xplain1.3-6base-8k-step2199 Layer 14 199237632 0.000833 signed |
| xplain1.3-6base-8k-step2199 Layer 20 199237632 0.000832 signed |
| xplain1.3-6base-8k-step2199 Layer 13 199237632 0.000808 signed |
| xplain1.3-6base-8k-step2199 Layer 12 199237632 0.000802 signed |
| xplain1.3-6base-8k-step2199 Layer 11 199237632 0.000783 signed |
| xplain1.3-6base-8k-step2199 Layer 10 199237632 0.000761 signed |
| xplain1.3-6base-8k-step2199 Layer 09 199237632 0.000736 signed |
| xplain1.3-6base-8k-step2199 Layer 08 199237632 0.000710 signed |
| xplain1.3-6base-8k-step2199 Layer 07 199237632 0.000691 signed |
| xplain1.3-6base-8k-step2199 Layer 06 199237632 0.000684 signed |
| xplain1.3-6base-8k-step2199 Layer 05 199237632 0.000665 signed |
| xplain1.3-6base-8k-step2199 Layer 04 199237632 0.000648 signed |
| xplain1.3-6base-8k-step2199 Layer 03 199237632 0.000563 signed |
| xplain1.3-6base-8k-step2199 Layer 02 199237632 0.000544 signed |
| xplain1.3-6base-8k-step2199 Layer 00 199237632 0.000541 signed |
| xplain1.3-6base-8k-step2199 Layer 01 199237632 0.000535 signed |
| |
| ### `xplain1.4-6base-16k-step2319` |
|
|
| model block_label count std stat_mode |
| xplain1.4-6base-16k-step2319 Layer 38 199237632 0.001784 signed |
| xplain1.4-6base-16k-step2319 Layer 37 199237632 0.001714 signed |
| xplain1.4-6base-16k-step2319 Layer 39 199237632 0.001580 signed |
| xplain1.4-6base-16k-step2319 Layer 36 199237632 0.001482 signed |
| xplain1.4-6base-16k-step2319 Layer 35 199237632 0.001424 signed |
| xplain1.4-6base-16k-step2319 Layer 34 199237632 0.001416 signed |
| xplain1.4-6base-16k-step2319 Layer 31 199237632 0.001349 signed |
| xplain1.4-6base-16k-step2319 Layer 32 199237632 0.001348 signed |
| xplain1.4-6base-16k-step2319 Layer 33 199237632 0.001346 signed |
| xplain1.4-6base-16k-step2319 Layer 30 199237632 0.001339 signed |
| xplain1.4-6base-16k-step2319 Layer 28 199237632 0.001325 signed |
| xplain1.4-6base-16k-step2319 Layer 25 199237632 0.001304 signed |
| xplain1.4-6base-16k-step2319 Layer 22 199237632 0.001278 signed |
| xplain1.4-6base-16k-step2319 Layer 21 199237632 0.001266 signed |
| xplain1.4-6base-16k-step2319 Layer 19 199237632 0.001251 signed |
| xplain1.4-6base-16k-step2319 Layer 29 199237632 0.001246 signed |
| xplain1.4-6base-16k-step2319 Layer 18 199237632 0.001232 signed |
| xplain1.4-6base-16k-step2319 Layer 27 199237632 0.001229 signed |
| xplain1.4-6base-16k-step2319 Layer 17 199237632 0.001220 signed |
| xplain1.4-6base-16k-step2319 Layer 26 199237632 0.001218 signed |
| xplain1.4-6base-16k-step2319 Layer 24 199237632 0.001200 signed |
| xplain1.4-6base-16k-step2319 Layer 16 199237632 0.001199 signed |
| xplain1.4-6base-16k-step2319 Layer 23 199237632 0.001190 signed |
| xplain1.4-6base-16k-step2319 Layer 15 199237632 0.001180 signed |
| xplain1.4-6base-16k-step2319 Layer 20 199237632 0.001160 signed |
| xplain1.4-6base-16k-step2319 Layer 14 199237632 0.001151 signed |
| xplain1.4-6base-16k-step2319 Layer 13 199237632 0.001126 signed |
| xplain1.4-6base-16k-step2319 Layer 12 199237632 0.001113 signed |
| xplain1.4-6base-16k-step2319 Layer 11 199237632 0.001093 signed |
| xplain1.4-6base-16k-step2319 Layer 10 199237632 0.001075 signed |
| xplain1.4-6base-16k-step2319 Layer 09 199237632 0.001057 signed |
| xplain1.4-6base-16k-step2319 Layer 08 199237632 0.001039 signed |
| xplain1.4-6base-16k-step2319 Layer 00 199237632 0.001036 signed |
| xplain1.4-6base-16k-step2319 Layer 04 199237632 0.001036 signed |
| xplain1.4-6base-16k-step2319 Layer 07 199237632 0.001030 signed |
| xplain1.4-6base-16k-step2319 Layer 06 199237632 0.001030 signed |
| xplain1.4-6base-16k-step2319 Layer 05 199237632 0.001024 signed |
| xplain1.4-6base-16k-step2319 Layer 01 199237632 0.001006 signed |
| xplain1.4-6base-16k-step2319 Layer 02 199237632 0.001004 signed |
| xplain1.4-6base-16k-step2319 Layer 03 199237632 0.001000 signed |
| |
| ### `xplain1.4-6base-32k-step1743` |
|
|
| model block_label count std stat_mode |
| xplain1.4-6base-32k-step1743 Layer 38 199237632 0.001992 signed |
| xplain1.4-6base-32k-step1743 Layer 37 199237632 0.001929 signed |
| xplain1.4-6base-32k-step1743 Layer 39 199237632 0.001778 signed |
| xplain1.4-6base-32k-step1743 Layer 36 199237632 0.001722 signed |
| xplain1.4-6base-32k-step1743 Layer 35 199237632 0.001661 signed |
| xplain1.4-6base-32k-step1743 Layer 34 199237632 0.001658 signed |
| xplain1.4-6base-32k-step1743 Layer 31 199237632 0.001601 signed |
| xplain1.4-6base-32k-step1743 Layer 32 199237632 0.001594 signed |
| xplain1.4-6base-32k-step1743 Layer 30 199237632 0.001592 signed |
| xplain1.4-6base-32k-step1743 Layer 33 199237632 0.001590 signed |
| xplain1.4-6base-32k-step1743 Layer 28 199237632 0.001575 signed |
| xplain1.4-6base-32k-step1743 Layer 25 199237632 0.001549 signed |
| xplain1.4-6base-32k-step1743 Layer 22 199237632 0.001512 signed |
| xplain1.4-6base-32k-step1743 Layer 21 199237632 0.001498 signed |
| xplain1.4-6base-32k-step1743 Layer 29 199237632 0.001482 signed |
| xplain1.4-6base-32k-step1743 Layer 19 199237632 0.001474 signed |
| xplain1.4-6base-32k-step1743 Layer 27 199237632 0.001462 signed |
| xplain1.4-6base-32k-step1743 Layer 18 199237632 0.001452 signed |
| xplain1.4-6base-32k-step1743 Layer 26 199237632 0.001448 signed |
| xplain1.4-6base-32k-step1743 Layer 17 199237632 0.001438 signed |
| xplain1.4-6base-32k-step1743 Layer 24 199237632 0.001426 signed |
| xplain1.4-6base-32k-step1743 Layer 16 199237632 0.001417 signed |
| xplain1.4-6base-32k-step1743 Layer 23 199237632 0.001414 signed |
| xplain1.4-6base-32k-step1743 Layer 15 199237632 0.001397 signed |
| xplain1.4-6base-32k-step1743 Layer 20 199237632 0.001376 signed |
| xplain1.4-6base-32k-step1743 Layer 14 199237632 0.001367 signed |
| xplain1.4-6base-32k-step1743 Layer 13 199237632 0.001344 signed |
| xplain1.4-6base-32k-step1743 Layer 00 199237632 0.001340 signed |
| xplain1.4-6base-32k-step1743 Layer 12 199237632 0.001331 signed |
| xplain1.4-6base-32k-step1743 Layer 01 199237632 0.001320 signed |
| xplain1.4-6base-32k-step1743 Layer 11 199237632 0.001314 signed |
| xplain1.4-6base-32k-step1743 Layer 10 199237632 0.001301 signed |
| xplain1.4-6base-32k-step1743 Layer 04 199237632 0.001290 signed |
| xplain1.4-6base-32k-step1743 Layer 09 199237632 0.001289 signed |
| xplain1.4-6base-32k-step1743 Layer 02 199237632 0.001284 signed |
| xplain1.4-6base-32k-step1743 Layer 08 199237632 0.001276 signed |
| xplain1.4-6base-32k-step1743 Layer 03 199237632 0.001275 signed |
| xplain1.4-6base-32k-step1743 Layer 05 199237632 0.001270 signed |
| xplain1.4-6base-32k-step1743 Layer 06 199237632 0.001269 signed |
| xplain1.4-6base-32k-step1743 Layer 07 199237632 0.001267 signed |
| |
| ### `xplain1.4-6base-64k-step1743` |
|
|
| model block_label count std stat_mode |
| xplain1.4-6base-64k-step1743 Layer 38 199237632 0.002120 signed |
| xplain1.4-6base-64k-step1743 Layer 37 199237632 0.002040 signed |
| xplain1.4-6base-64k-step1743 Layer 39 199237632 0.001909 signed |
| xplain1.4-6base-64k-step1743 Layer 36 199237632 0.001846 signed |
| xplain1.4-6base-64k-step1743 Layer 34 199237632 0.001789 signed |
| xplain1.4-6base-64k-step1743 Layer 35 199237632 0.001785 signed |
| xplain1.4-6base-64k-step1743 Layer 31 199237632 0.001745 signed |
| xplain1.4-6base-64k-step1743 Layer 30 199237632 0.001735 signed |
| xplain1.4-6base-64k-step1743 Layer 32 199237632 0.001732 signed |
| xplain1.4-6base-64k-step1743 Layer 33 199237632 0.001722 signed |
| xplain1.4-6base-64k-step1743 Layer 28 199237632 0.001721 signed |
| xplain1.4-6base-64k-step1743 Layer 25 199237632 0.001697 signed |
| xplain1.4-6base-64k-step1743 Layer 22 199237632 0.001658 signed |
| xplain1.4-6base-64k-step1743 Layer 21 199237632 0.001643 signed |
| xplain1.4-6base-64k-step1743 Layer 29 199237632 0.001619 signed |
| xplain1.4-6base-64k-step1743 Layer 19 199237632 0.001614 signed |
| xplain1.4-6base-64k-step1743 Layer 27 199237632 0.001600 signed |
| xplain1.4-6base-64k-step1743 Layer 18 199237632 0.001592 signed |
| xplain1.4-6base-64k-step1743 Layer 26 199237632 0.001587 signed |
| xplain1.4-6base-64k-step1743 Layer 17 199237632 0.001577 signed |
| xplain1.4-6base-64k-step1743 Layer 24 199237632 0.001565 signed |
| xplain1.4-6base-64k-step1743 Layer 16 199237632 0.001554 signed |
| xplain1.4-6base-64k-step1743 Layer 23 199237632 0.001552 signed |
| xplain1.4-6base-64k-step1743 Layer 15 199237632 0.001533 signed |
| xplain1.4-6base-64k-step1743 Layer 20 199237632 0.001510 signed |
| xplain1.4-6base-64k-step1743 Layer 14 199237632 0.001501 signed |
| xplain1.4-6base-64k-step1743 Layer 13 199237632 0.001479 signed |
| xplain1.4-6base-64k-step1743 Layer 12 199237632 0.001466 signed |
| xplain1.4-6base-64k-step1743 Layer 11 199237632 0.001449 signed |
| xplain1.4-6base-64k-step1743 Layer 10 199237632 0.001436 signed |
| xplain1.4-6base-64k-step1743 Layer 09 199237632 0.001425 signed |
| xplain1.4-6base-64k-step1743 Layer 08 199237632 0.001414 signed |
| xplain1.4-6base-64k-step1743 Layer 00 199237632 0.001412 signed |
| xplain1.4-6base-64k-step1743 Layer 07 199237632 0.001401 signed |
| xplain1.4-6base-64k-step1743 Layer 01 199237632 0.001401 signed |
| xplain1.4-6base-64k-step1743 Layer 06 199237632 0.001400 signed |
| xplain1.4-6base-64k-step1743 Layer 05 199237632 0.001388 signed |
| xplain1.4-6base-64k-step1743 Layer 04 199237632 0.001370 signed |
| xplain1.4-6base-64k-step1743 Layer 02 199237632 0.001358 signed |
| xplain1.4-6base-64k-step1743 Layer 03 199237632 0.001353 signed |
| |
| ### `xplain1.4-6base-8k-step2319` |
|
|
| model block_label count std stat_mode |
| xplain1.4-6base-8k-step2319 Layer 38 199237632 0.001407 signed |
| xplain1.4-6base-8k-step2319 Layer 37 199237632 0.001340 signed |
| xplain1.4-6base-8k-step2319 Layer 39 199237632 0.001194 signed |
| xplain1.4-6base-8k-step2319 Layer 36 199237632 0.001110 signed |
| xplain1.4-6base-8k-step2319 Layer 35 199237632 0.001067 signed |
| xplain1.4-6base-8k-step2319 Layer 34 199237632 0.001059 signed |
| xplain1.4-6base-8k-step2319 Layer 33 199237632 0.000993 signed |
| xplain1.4-6base-8k-step2319 Layer 32 199237632 0.000990 signed |
| xplain1.4-6base-8k-step2319 Layer 31 199237632 0.000988 signed |
| xplain1.4-6base-8k-step2319 Layer 30 199237632 0.000982 signed |
| xplain1.4-6base-8k-step2319 Layer 28 199237632 0.000975 signed |
| xplain1.4-6base-8k-step2319 Layer 25 199237632 0.000966 signed |
| xplain1.4-6base-8k-step2319 Layer 22 199237632 0.000954 signed |
| xplain1.4-6base-8k-step2319 Layer 19 199237632 0.000948 signed |
| xplain1.4-6base-8k-step2319 Layer 21 199237632 0.000948 signed |
| xplain1.4-6base-8k-step2319 Layer 18 199237632 0.000933 signed |
| xplain1.4-6base-8k-step2319 Layer 17 199237632 0.000926 signed |
| xplain1.4-6base-8k-step2319 Layer 29 199237632 0.000920 signed |
| xplain1.4-6base-8k-step2319 Layer 27 199237632 0.000912 signed |
| xplain1.4-6base-8k-step2319 Layer 16 199237632 0.000910 signed |
| xplain1.4-6base-8k-step2319 Layer 26 199237632 0.000907 signed |
| xplain1.4-6base-8k-step2319 Layer 15 199237632 0.000896 signed |
| xplain1.4-6base-8k-step2319 Layer 24 199237632 0.000896 signed |
| xplain1.4-6base-8k-step2319 Layer 23 199237632 0.000890 signed |
| xplain1.4-6base-8k-step2319 Layer 14 199237632 0.000873 signed |
| xplain1.4-6base-8k-step2319 Layer 20 199237632 0.000871 signed |
| xplain1.4-6base-8k-step2319 Layer 13 199237632 0.000852 signed |
| xplain1.4-6base-8k-step2319 Layer 12 199237632 0.000840 signed |
| xplain1.4-6base-8k-step2319 Layer 11 199237632 0.000826 signed |
| xplain1.4-6base-8k-step2319 Layer 10 199237632 0.000811 signed |
| xplain1.4-6base-8k-step2319 Layer 09 199237632 0.000794 signed |
| xplain1.4-6base-8k-step2319 Layer 04 199237632 0.000781 signed |
| xplain1.4-6base-8k-step2319 Layer 08 199237632 0.000777 signed |
| xplain1.4-6base-8k-step2319 Layer 07 199237632 0.000770 signed |
| xplain1.4-6base-8k-step2319 Layer 06 199237632 0.000769 signed |
| xplain1.4-6base-8k-step2319 Layer 05 199237632 0.000766 signed |
| xplain1.4-6base-8k-step2319 Layer 00 199237632 0.000746 signed |
| xplain1.4-6base-8k-step2319 Layer 02 199237632 0.000734 signed |
| xplain1.4-6base-8k-step2319 Layer 03 199237632 0.000734 signed |
| xplain1.4-6base-8k-step2319 Layer 01 199237632 0.000724 signed |
| |
| ### `xplain1.4-7base-32k-step1743` |
|
|
| model block_label count std stat_mode |
| xplain1.4-7base-32k-step1743 Layer 36 199237632 0.001582 signed |
| xplain1.4-7base-32k-step1743 Layer 38 199237632 0.001579 signed |
| xplain1.4-7base-32k-step1743 Layer 37 199237632 0.001578 signed |
| xplain1.4-7base-32k-step1743 Layer 34 199237632 0.001548 signed |
| xplain1.4-7base-32k-step1743 Layer 35 199237632 0.001533 signed |
| xplain1.4-7base-32k-step1743 Layer 31 199237632 0.001490 signed |
| xplain1.4-7base-32k-step1743 Layer 32 199237632 0.001485 signed |
| xplain1.4-7base-32k-step1743 Layer 33 199237632 0.001478 signed |
| xplain1.4-7base-32k-step1743 Layer 30 199237632 0.001478 signed |
| xplain1.4-7base-32k-step1743 Layer 39 199237632 0.001470 signed |
| xplain1.4-7base-32k-step1743 Layer 28 199237632 0.001458 signed |
| xplain1.4-7base-32k-step1743 Layer 25 199237632 0.001429 signed |
| xplain1.4-7base-32k-step1743 Layer 22 199237632 0.001393 signed |
| xplain1.4-7base-32k-step1743 Layer 21 199237632 0.001378 signed |
| xplain1.4-7base-32k-step1743 Layer 29 199237632 0.001366 signed |
| xplain1.4-7base-32k-step1743 Layer 19 199237632 0.001364 signed |
| xplain1.4-7base-32k-step1743 Layer 27 199237632 0.001347 signed |
| xplain1.4-7base-32k-step1743 Layer 18 199237632 0.001343 signed |
| xplain1.4-7base-32k-step1743 Layer 17 199237632 0.001337 signed |
| xplain1.4-7base-32k-step1743 Layer 26 199237632 0.001335 signed |
| xplain1.4-7base-32k-step1743 Layer 16 199237632 0.001315 signed |
| xplain1.4-7base-32k-step1743 Layer 24 199237632 0.001310 signed |
| xplain1.4-7base-32k-step1743 Layer 15 199237632 0.001303 signed |
| xplain1.4-7base-32k-step1743 Layer 23 199237632 0.001299 signed |
| xplain1.4-7base-32k-step1743 Layer 14 199237632 0.001274 signed |
| xplain1.4-7base-32k-step1743 Layer 20 199237632 0.001263 signed |
| xplain1.4-7base-32k-step1743 Layer 13 199237632 0.001257 signed |
| xplain1.4-7base-32k-step1743 Layer 12 199237632 0.001241 signed |
| xplain1.4-7base-32k-step1743 Layer 11 199237632 0.001209 signed |
| xplain1.4-7base-32k-step1743 Layer 10 199237632 0.001181 signed |
| xplain1.4-7base-32k-step1743 Layer 09 199237632 0.001158 signed |
| xplain1.4-7base-32k-step1743 Layer 08 199237632 0.001131 signed |
| xplain1.4-7base-32k-step1743 Layer 06 199237632 0.001112 signed |
| xplain1.4-7base-32k-step1743 Layer 07 199237632 0.001107 signed |
| xplain1.4-7base-32k-step1743 Layer 05 199237632 0.001093 signed |
| xplain1.4-7base-32k-step1743 Layer 04 199237632 0.001086 signed |
| xplain1.4-7base-32k-step1743 Layer 03 199237632 0.001056 signed |
| xplain1.4-7base-32k-step1743 Layer 02 199237632 0.001010 signed |
| xplain1.4-7base-32k-step1743 Layer 01 199237632 0.000961 signed |
| xplain1.4-7base-32k-step1743 Layer 00 199237632 0.000917 signed |
| |
| ## Module types by std |
|
|
| ### `xplain1.3-6base-16k-step2199` |
|
|
| model module_type count std stat_mode |
| xplain1.3-6base-16k-step2199 input_layernorm 163840 0.002186 signed |
| xplain1.3-6base-16k-step2199 mlp.gate_proj 2097152000 0.001318 signed |
| xplain1.3-6base-16k-step2199 post_attention_layernorm 163840 0.001232 signed |
| xplain1.3-6base-16k-step2199 mlp.up_proj 2097152000 0.001229 signed |
| xplain1.3-6base-16k-step2199 mlp.down_proj 2097152000 0.001185 signed |
| xplain1.3-6base-16k-step2199 self_attn.q_proj 671088640 0.001164 signed |
| xplain1.3-6base-16k-step2199 self_attn.k_proj 167772160 0.001097 signed |
| xplain1.3-6base-16k-step2199 self_attn.o_proj 671088640 0.000932 signed |
| xplain1.3-6base-16k-step2199 self_attn.v_proj 167772160 0.000902 signed |
| |
| ### `xplain1.3-6base-32k-step1647` |
|
|
| model module_type count std stat_mode |
| xplain1.3-6base-32k-step1647 input_layernorm 163840 0.002933 signed |
| xplain1.3-6base-32k-step1647 mlp.gate_proj 2097152000 0.001524 signed |
| xplain1.3-6base-32k-step1647 post_attention_layernorm 163840 0.001465 signed |
| xplain1.3-6base-32k-step1647 mlp.up_proj 2097152000 0.001415 signed |
| xplain1.3-6base-32k-step1647 mlp.down_proj 2097152000 0.001370 signed |
| xplain1.3-6base-32k-step1647 self_attn.q_proj 671088640 0.001339 signed |
| xplain1.3-6base-32k-step1647 self_attn.k_proj 167772160 0.001255 signed |
| xplain1.3-6base-32k-step1647 self_attn.o_proj 671088640 0.001058 signed |
| xplain1.3-6base-32k-step1647 self_attn.v_proj 167772160 0.001018 signed |
| |
| ### `xplain1.3-6base-64k-step1647` |
|
|
| model module_type count std stat_mode |
| xplain1.3-6base-64k-step1647 input_layernorm 163840 0.003692 signed |
| xplain1.3-6base-64k-step1647 post_attention_layernorm 163840 0.001730 signed |
| xplain1.3-6base-64k-step1647 mlp.gate_proj 2097152000 0.001716 signed |
| xplain1.3-6base-64k-step1647 mlp.up_proj 2097152000 0.001599 signed |
| xplain1.3-6base-64k-step1647 mlp.down_proj 2097152000 0.001552 signed |
| xplain1.3-6base-64k-step1647 self_attn.q_proj 671088640 0.001510 signed |
| xplain1.3-6base-64k-step1647 self_attn.k_proj 167772160 0.001416 signed |
| xplain1.3-6base-64k-step1647 self_attn.o_proj 671088640 0.001227 signed |
| xplain1.3-6base-64k-step1647 self_attn.v_proj 167772160 0.001183 signed |
| |
| ### `xplain1.3-6base-8k-step2199` |
|
|
| model module_type count std stat_mode |
| xplain1.3-6base-8k-step2199 input_layernorm 163840 0.001203 signed |
| xplain1.3-6base-8k-step2199 mlp.gate_proj 2097152000 0.000944 signed |
| xplain1.3-6base-8k-step2199 mlp.up_proj 2097152000 0.000870 signed |
| xplain1.3-6base-8k-step2199 mlp.down_proj 2097152000 0.000842 signed |
| xplain1.3-6base-8k-step2199 self_attn.q_proj 671088640 0.000816 signed |
| xplain1.3-6base-8k-step2199 post_attention_layernorm 163840 0.000791 signed |
| xplain1.3-6base-8k-step2199 self_attn.k_proj 167772160 0.000770 signed |
| xplain1.3-6base-8k-step2199 self_attn.o_proj 671088640 0.000597 signed |
| xplain1.3-6base-8k-step2199 self_attn.v_proj 167772160 0.000571 signed |
| |
| ### `xplain1.4-6base-16k-step2319` |
|
|
| model module_type count std stat_mode |
| xplain1.4-6base-16k-step2319 input_layernorm 163840 0.002340 signed |
| xplain1.4-6base-16k-step2319 mlp.gate_proj 2097152000 0.001364 signed |
| xplain1.4-6base-16k-step2319 post_attention_layernorm 163840 0.001322 signed |
| xplain1.4-6base-16k-step2319 mlp.up_proj 2097152000 0.001263 signed |
| xplain1.4-6base-16k-step2319 mlp.down_proj 2097152000 0.001219 signed |
| xplain1.4-6base-16k-step2319 self_attn.q_proj 671088640 0.001180 signed |
| xplain1.4-6base-16k-step2319 self_attn.k_proj 167772160 0.001101 signed |
| xplain1.4-6base-16k-step2319 self_attn.o_proj 671088640 0.000976 signed |
| xplain1.4-6base-16k-step2319 self_attn.v_proj 167772160 0.000919 signed |
| |
| ### `xplain1.4-6base-32k-step1743` |
|
|
| model module_type count std stat_mode |
| xplain1.4-6base-32k-step1743 input_layernorm 163840 0.003153 signed |
| xplain1.4-6base-32k-step1743 mlp.gate_proj 2097152000 0.001612 signed |
| xplain1.4-6base-32k-step1743 post_attention_layernorm 163840 0.001604 signed |
| xplain1.4-6base-32k-step1743 mlp.up_proj 2097152000 0.001500 signed |
| xplain1.4-6base-32k-step1743 mlp.down_proj 2097152000 0.001444 signed |
| xplain1.4-6base-32k-step1743 self_attn.q_proj 671088640 0.001407 signed |
| xplain1.4-6base-32k-step1743 self_attn.k_proj 167772160 0.001313 signed |
| xplain1.4-6base-32k-step1743 self_attn.o_proj 671088640 0.001195 signed |
| xplain1.4-6base-32k-step1743 self_attn.v_proj 167772160 0.001136 signed |
| |
| ### `xplain1.4-6base-64k-step1743` |
|
|
| model module_type count std stat_mode |
| xplain1.4-6base-64k-step1743 input_layernorm 163840 0.003853 signed |
| xplain1.4-6base-64k-step1743 post_attention_layernorm 163840 0.001784 signed |
| xplain1.4-6base-64k-step1743 mlp.gate_proj 2097152000 0.001755 signed |
| xplain1.4-6base-64k-step1743 mlp.up_proj 2097152000 0.001630 signed |
| xplain1.4-6base-64k-step1743 mlp.down_proj 2097152000 0.001564 signed |
| xplain1.4-6base-64k-step1743 self_attn.q_proj 671088640 0.001528 signed |
| xplain1.4-6base-64k-step1743 self_attn.k_proj 167772160 0.001424 signed |
| xplain1.4-6base-64k-step1743 self_attn.o_proj 671088640 0.001301 signed |
| xplain1.4-6base-64k-step1743 self_attn.v_proj 167772160 0.001245 signed |
| |
| ### `xplain1.4-6base-8k-step2319` |
|
|
| model module_type count std stat_mode |
| xplain1.4-6base-8k-step2319 input_layernorm 163840 0.001287 signed |
| xplain1.4-6base-8k-step2319 mlp.gate_proj 2097152000 0.001025 signed |
| xplain1.4-6base-8k-step2319 mlp.up_proj 2097152000 0.000950 signed |
| xplain1.4-6base-8k-step2319 mlp.down_proj 2097152000 0.000910 signed |
| xplain1.4-6base-8k-step2319 post_attention_layernorm 163840 0.000906 signed |
| xplain1.4-6base-8k-step2319 self_attn.q_proj 671088640 0.000873 signed |
| xplain1.4-6base-8k-step2319 self_attn.k_proj 167772160 0.000821 signed |
| xplain1.4-6base-8k-step2319 self_attn.o_proj 671088640 0.000747 signed |
| xplain1.4-6base-8k-step2319 self_attn.v_proj 167772160 0.000709 signed |
| |
| ### `xplain1.4-7base-32k-step1743` |
|
|
| model module_type count std stat_mode |
| xplain1.4-7base-32k-step1743 input_layernorm 163840 0.002731 signed |
| xplain1.4-7base-32k-step1743 post_attention_layernorm 163840 0.001456 signed |
| xplain1.4-7base-32k-step1743 mlp.gate_proj 2097152000 0.001452 signed |
| xplain1.4-7base-32k-step1743 mlp.up_proj 2097152000 0.001344 signed |
| xplain1.4-7base-32k-step1743 mlp.down_proj 2097152000 0.001307 signed |
| xplain1.4-7base-32k-step1743 self_attn.q_proj 671088640 0.001239 signed |
| xplain1.4-7base-32k-step1743 self_attn.k_proj 167772160 0.001151 signed |
| xplain1.4-7base-32k-step1743 self_attn.o_proj 671088640 0.000990 signed |
| xplain1.4-7base-32k-step1743 self_attn.v_proj 167772160 0.000926 signed |
| |
|
|
