cuimiandashi commited on
Commit
aabdeaf
·
verified ·
1 Parent(s): b888f48

Upload GVHD_Final_Report.ipynb

Browse files
Files changed (1) hide show
  1. GVHD_Final_Report.ipynb +92 -0
GVHD_Final_Report.ipynb ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cells": [
3
+ {
4
+ "cell_type": "markdown",
5
+ "metadata": {},
6
+ "source": [
7
+ "# GVHD Severity Prediction - Final Report\n",
8
+ "\n",
9
+ "**GPU-Optimized Pipeline with Feature Engineering and Stacking**\n",
10
+ "\n",
11
+ "| Metric | Value |\n",
12
+ "|--------|-------|\n",
13
+ "| Best Model | Stacking Ensemble |\n",
14
+ "| **AUC** | **0.7083 ± 0.0117** |\n",
15
+ "| Baseline AUC | 0.7034 |\n",
16
+ "| Improvement | +0.0049 (+0.7%) |\n",
17
+ "| Brier (Platt) | 0.2019 |\n",
18
+ "| Threshold | 0.544 |\n",
19
+ "| Sensitivity | 68.4% |\n",
20
+ "| Specificity | 58.8% |\n",
21
+ "| PPV | 76.9% |\n",
22
+ "| NPV | 48.3% |"
23
+ ]
24
+ },
25
+ {
26
+ "cell_type": "markdown",
27
+ "metadata": {},
28
+ "source": [
29
+ "## Table 1: Model Comparison\n",
30
+ "\n",
31
+ "| Model | AUC Mean | AUC Std | Fold1 | Fold2 | Fold3 | Fold4 | Fold5 |\n",
32
+ "|-------|----------|---------|-------|-------|-------|-------|-------|\n",
33
+ "| CatBoost | 0.6963 | ±0.0105 | 0.700 | 0.711 | 0.699 | 0.679 | 0.694 |\n",
34
+ "| XGBoost | 0.6986 | ±0.0126 | 0.705 | 0.711 | 0.704 | 0.675 | 0.698 |\n",
35
+ "| NeuralNet | 0.6870 | ±0.0088 | 0.692 | 0.699 | 0.698 | 0.677 | 0.681 |\n",
36
+ "| **Stacking** | **0.7083** | **±0.0117** | **0.714** | **0.722** | **0.714** | **0.688** | **0.703** |"
37
+ ]
38
+ },
39
+ {
40
+ "cell_type": "markdown",
41
+ "metadata": {},
42
+ "source": [
43
+ "## Table 2: Calibration Assessment\n",
44
+ "\n",
45
+ "| Method | Brier Score |\n",
46
+ "|--------|------------|\n",
47
+ "| Raw | 0.2150 |\n",
48
+ "| Platt Scaling | 0.2019 |\n",
49
+ "| Isotonic | 0.2024 |"
50
+ ]
51
+ },
52
+ {
53
+ "cell_type": "markdown",
54
+ "metadata": {},
55
+ "source": [
56
+ "## Table 3: Optimal Threshold\n",
57
+ "\n",
58
+ "| Metric | Value |\n",
59
+ "|--------|-------|\n",
60
+ "| Youden's J | 0.544 |\n",
61
+ "| Sensitivity | 68.4% |\n",
62
+ "| Specificity | 58.8% |\n",
63
+ "| PPV | 76.9% |\n",
64
+ "| NPV | 48.3% |"
65
+ ]
66
+ },
67
+ {
68
+ "cell_type": "code",
69
+ "execution_count": null,
70
+ "metadata": {},
71
+ "outputs": [],
72
+ "source": [
73
+ "import pandas as pd\n",
74
+ "results = pd.read_csv('/app/result_comparison_final.csv')\n",
75
+ "print(results.to_string(index=False))"
76
+ ]
77
+ }
78
+ ],
79
+ "metadata": {
80
+ "kernelspec": {
81
+ "display_name": "Python 3",
82
+ "language": "python",
83
+ "name": "python3"
84
+ },
85
+ "language_info": {
86
+ "name": "python",
87
+ "version": "3.12.0"
88
+ }
89
+ },
90
+ "nbformat": 4,
91
+ "nbformat_minor": 4
92
+ }