Ablation F-HIGH-F5_identity

Ablation F-MID-F5_identity

Ablation F-LOW-F5_identity

Ablation F-HIGH-F4_tanh

Ablation F-MID-F4_tanh

Ablation F-LOW-F4_tanh

Ablation F-HIGH-F3_silu

Ablation F-MID-F3_silu

Ablation F-LOW-F3_silu

Ablation F-HIGH-F2_relu

Ablation F-MID-F2_relu

Ablation F-LOW-F2_relu

Ablation F-HIGH-F1_gelu

Ablation F-MID-F1_gelu

Ablation F-LOW-F1_gelu