BioHCL-SSSM-Complete-Workspace / deliverables /3_table2_layer_hyperparameter_deduction.csv
unknownBrain's picture
Complete medical imaging workspace dump (weights, deliverables, papers, notebooks, code, figures)
eded815 verified
Raw History Blame Contribute Delete
2.7 kB
SSSM_Hyperparameter,Configuration_Tested,Parameters_M,Complexity_GFLOPs,Inference_Latency_ms,Val_Accuracy_pct,Val_F1_Score,Deduction_Decision,Deduction_Rationale
Block Depth (L),L = 1 Block,10.28,6.93,34.8,91.4,0.932,Rejected,Under-parameterized; sequence depth insufficient to model multi-scale bilateral pulmonary context.
Block Depth (L),L = 2 Blocks,12.15,7.74,41.5,97.61,0.9841,Candidate,"High computational efficiency with strong performance, but minor sensitivity drop on mild infiltrates."
Block Depth (L),L = 3 Blocks,14.01,8.56,49.06,99.81,0.9987,Selected (Optimal),Optimal Pareto frontier: peak accuracy and F1 score with 14.01M params without gradient dissipation.
Block Depth (L),L = 4 Blocks,15.88,9.37,56.7,96.66,0.9777,Rejected,"Diminishing returns (+13.3% params, +9.5% FLOPs) with minor over-fitting plateau."
Block Depth (L),L = 6 Blocks,19.61,10.99,72.3,95.2,0.965,Rejected,Over-parameterized; latency climbs to 72.3ms with noticeable generalization penalty.
State Dimension (d_state),d_state = 16,13.82,8.44,46.2,94.8,0.958,Rejected,State capacity bottleneck; continuous hidden state too constrained to capture fine bronchovascular detail.
State Dimension (d_state),d_state = 32,13.91,8.5,47.8,97.2,0.981,Candidate,Adequate representation; slightly lower accuracy on difficult viral/bacterial differentiation.
State Dimension (d_state),d_state = 64,14.01,8.56,49.06,99.81,0.9987,Selected (Optimal),Optimal memory expressivity; perfectly balances continuous recurrent dynamics and memory footprint.
State Dimension (d_state),d_state = 128,16.41,9.72,61.2,96.66,0.9777,Rejected,Capacity saturation; +17% param growth and +24% latency penalty without statistical performance gain.
Channel Expansion Factor (E),E = 1 (No Expansion),11.9,7.6,39.5,95.1,0.961,Rejected,Narrow projection restricts non-linear manifold transformation prior to selective scanning.
Channel Expansion Factor (E),E = 2 (Standard Mamba),14.01,8.56,49.06,99.81,0.9987,Selected (Optimal),Standard state expansion ratio; enables expressive non-linear gating with minimal compute overhead.
Channel Expansion Factor (E),E = 4 (High Expansion),18.25,11.2,75.4,97.1,0.979,Rejected,Severe parameter explosion with pronounced risk of overfitting on pediatric cohort sample size.
Residual Connection Strategy,No Skip Connection (Strict Sequential),14.01,8.56,48.5,89.2,0.912,Rejected,Degradation problem; deep continuous recurrent transitions attenuate gradient flow during backpropagation.
Residual Connection Strategy,Additive Residual Highway (Selected),14.01,8.56,49.06,99.81,0.9987,Selected (Optimal),Preserves low-frequency spatial references throughout non-linear continuous ODE state transitions.