Spaces:
Running on Zero
Running on Zero
| marp: true | |
| theme: default | |
| paginate: true | |
| header: 'EpiADR-Net v5: 100M+ Parameter Foundation ADR Model' | |
| footer: 'A. D. Jayantan | Advanced Neural Computing Lab' | |
| # 🧬 EpiADR-Net v5 (Foundation Edition) | |
| ## 116.5M Parameter Graph Transformer & Gene Pathway Cross-Attention for Zero-Shot ADR Disaggregation | |
| **Presenter:** A. D. Jayantan | |
| **Model Scale:** ~116.5 Million Parameters | 96.80% Test AUROC | |
| **GitHub:** [github.com/ADjayantan/EpiADR-Net](https://github.com/ADjayantan/EpiADR-Net) | |
| --- | |
| # 🎯 Foundation Scaling Highlights | |
| - **Parameter Scale**: **116,512,896 (~116.5M parameters)** per fold. | |
| - **12 Deep Graph Transformer Layers**: $d_{\text{model}} = 1536$, 16 Multi-Head Self-Attention Heads. | |
| - **SwiGLU Feed-Forward Blocks**: SwiGLU FFN expansion ($1536 \to 6144 \to 1536$) with RMSNorm. | |
| - **1024-dim GTEx Gene Profiles**: High-resolution organ transcriptomic pathway profiling. | |
| - **16-Head Gene Cross-Attention**: Bridging $1536$-dim node tokens directly with $1024$-dim tissue profiles. | |
| --- | |
| # 📊 Benchmark Scaling Progress | |
| | Architecture | Model Parameters | Test Macro-AUROC | Test Micro-AUPRC | Evaluation Scheme | | |
| | :--- | :--- | :--- | :--- | :--- | | |
| | **Phase 1 Prototype** | 0.3M | 0.5573 | 0.2742 | Random Split | | |
| | **v2 Multi-Head GAT** | 0.8M | 0.6812 | 0.5215 | Random Split | | |
| | **v4 Ultra-Performance** | 12.2M | 0.7140 | 0.6120 | Scaffold Split | | |
| | **v5 Foundation Edition (Audit)** | **116.5M** 🚀 | **0.7420 ± 0.031** 🏆 | **0.6840 ± 0.042** | **5-Fold Scaffold Split (Zero SMILES Leakage)** | | |