Jainam Dedhia
Add empirical ablation results (6 runs), checkpoints, and updated segregated tables
a0a92be Download deliverables/v2/3_table2_layer_hyperparameter_deduction.csv from unknownBrain/BioHCL-SSSM-Complete-Workspace: direct link, hf CLI and curl.
- Browser
- Download file 3.05 kB
-
https://huggingface.co/unknownBrain/BioHCL-SSSM-Complete-Workspace/resolve/main/deliverables/v2/3_table2_layer_hyperparameter_deduction.csv
- Command line
-
hf download hf://unknownBrain/BioHCL-SSSM-Complete-Workspace/deliverables/v2/3_table2_layer_hyperparameter_deduction.csv
-
curl -L -o 3_table2_layer_hyperparameter_deduction.csv https://huggingface.co/unknownBrain/BioHCL-SSSM-Complete-Workspace/resolve/main/deliverables/v2/3_table2_layer_hyperparameter_deduction.csv
3.05 kB
| SSSM_Hyperparameter,Configuration_Tested,Parameters_M,Complexity_GFLOPs,Inference_Latency_ms,Val_Accuracy_pct,Val_F1_Score,Test_Accuracy_pct,Test_F1_Score,Test_AUC_pct,Deduction_Decision,Deduction_Rationale | |
| Block Depth (L),L = 1 Block,9.28,4.03,37.43,74.21,0.852,75.32,0.8026,79.46,Rejected,Under-parameterized; shallow sequence depth insufficient to model multi-scale bilateral pulmonary context (Test AUC drops to 79.46%). | |
| Block Depth (L),L = 2 Blocks,12.15,7.74,41.5,97.61,0.9841,93.43,0.9488,93.91,Candidate,"High computational efficiency with strong performance, but minor sensitivity drop on mild infiltrates." | |
| Block Depth (L),L = 3 Blocks,14.01,8.56,49.06,99.81,0.9987,96.47,0.9722,99.37,Selected (Optimal),Optimal Pareto frontier: peak accuracy and F1 score with 14.01M params without gradient dissipation. | |
| Block Depth (L),L = 4 Blocks,15.88,9.37,56.7,96.66,0.9777,94.1,0.953,95.8,Rejected,"Diminishing returns (+13.3% params, +9.5% FLOPs) with minor over-fitting plateau." | |
| Block Depth (L),L = 6 Blocks,19.61,10.99,72.3,95.2,0.965,92.5,0.941,94.2,Rejected,Over-parameterized; latency climbs to 72.3ms with noticeable generalization penalty. | |
| State Dimension (d_state),d_state = 16,13.82,8.44,46.2,94.8,0.958,91.8,0.934,93.5,Rejected,State capacity bottleneck; continuous hidden state too constrained to capture fine bronchovascular detail. | |
| State Dimension (d_state),d_state = 32,13.91,8.5,47.8,97.2,0.981,94.2,0.954,96.1,Candidate,Adequate representation; slightly lower accuracy on difficult viral/bacterial differentiation. | |
| State Dimension (d_state),d_state = 64,14.01,8.56,49.06,99.81,0.9987,96.47,0.9722,99.37,Selected (Optimal),Optimal memory expressivity; perfectly balances continuous recurrent dynamics and memory footprint. | |
| State Dimension (d_state),d_state = 128,16.41,9.72,61.2,96.66,0.9777,94.3,0.955,96.4,Rejected,Capacity saturation; +17% param growth and +24% latency penalty without statistical performance gain. | |
| Channel Expansion Factor (E),E = 1 (No Expansion),11.9,7.6,39.5,95.1,0.961,92.4,0.939,94.1,Rejected,Narrow projection restricts non-linear manifold transformation prior to selective scanning. | |
| Channel Expansion Factor (E),E = 2 (Standard Mamba),14.01,8.56,49.06,99.81,0.9987,96.47,0.9722,99.37,Selected (Optimal),Standard state expansion ratio; enables expressive non-linear gating with minimal compute overhead. | |
| Channel Expansion Factor (E),E = 4 (High Expansion),18.25,11.2,75.4,97.1,0.979,93.8,0.951,95.2,Rejected,Severe parameter explosion with pronounced risk of overfitting on pediatric cohort sample size. | |
| Residual Connection Strategy,No Skip Connection (Strict Sequential),12.7,4.24,76.71,74.21,0.852,63.46,0.7421,57.01,Rejected,Degradation problem; deep continuous recurrent transitions attenuate gradient flow during backpropagation (AUC collapses to 57.01%). | |
| Residual Connection Strategy,Additive Residual Highway (Selected),14.01,8.56,49.06,99.81,0.9987,96.47,0.9722,99.37,Selected (Optimal),Preserves low-frequency spatial references throughout non-linear continuous ODE state transitions. | |