diff --git a/.gitattributes b/.gitattributes index a6344aac8c09253b3b630fb776ae94478aa0275b..f5740963101bbc6a816e7f89bb57e59e3bbabf1f 100644 --- a/.gitattributes +++ b/.gitattributes @@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text *.zip filter=lfs diff=lfs merge=lfs -text *.zst filter=lfs diff=lfs merge=lfs -text *tfevents* filter=lfs diff=lfs merge=lfs -text +training_curves/PiT_combined_metrics.png filter=lfs diff=lfs merge=lfs -text +training_notebook_c2.ipynb filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..fcf4df1070999b97e2a6dd7f4a1563492d6c92b4 --- /dev/null +++ b/README.md @@ -0,0 +1,166 @@ +--- +license: apache-2.0 +tags: +- image-classification +- pytorch +- timm +- pit +- vision-transformer +- transformer +- gravitational-lensing +- strong-lensing +- astronomy +- astrophysics +datasets: +- parlange/gravit-c21-j24 +metrics: +- accuracy +- auc +- f1 +paper: +- title: "GraViT: A Gravitational Lens Discovery Toolkit with Vision Transformers" + url: "https://arxiv.org/abs/2509.00226" + authors: "Parlange et al." +model-index: +- name: PiT-c2 + results: + - task: + type: image-classification + name: Strong Gravitational Lens Discovery + dataset: + type: common-test-sample + name: Common Test Sample (More et al. 2024) + metrics: + - type: accuracy + value: 0.8074 + name: Average Accuracy + - type: auc + value: 0.8443 + name: Average AUC-ROC + - type: f1 + value: 0.5437 + name: Average F1-Score +--- + +# 🌌 pit-gravit-c2 + +πŸ”­ This model is part of **GraViT**: Transfer Learning with Vision Transformers and MLP-Mixer for Strong Gravitational Lens Discovery + +πŸ”— **GitHub Repository**: [https://github.com/parlange/gravit](https://github.com/parlange/gravit) + +## πŸ›°οΈ Model Details + +- **πŸ€– Model Type**: PiT +- **πŸ§ͺ Experiment**: C2 - C21+J24-half +- **🌌 Dataset**: C21+J24 +- **πŸͺ Fine-tuning Strategy**: half + + + +## πŸ’» Quick Start + +```python +import torch +import timm + +# Load the model directly from the Hub +model = timm.create_model( + 'hf-hub:parlange/pit-gravit-c2', + pretrained=True +) +model.eval() + +# Example inference +dummy_input = torch.randn(1, 3, 224, 224) +with torch.no_grad(): + output = model(dummy_input) + predictions = torch.softmax(output, dim=1) +print(f"Lens probability: {predictions[0][1]:.4f}") +``` + +## ⚑️ Training Configuration + +**Training Dataset:** C21+J24 (CaΓ±ameras et al. 2021 + Jaelani et al. 2024) +**Fine-tuning Strategy:** half + + +| πŸ”§ Parameter | πŸ“ Value | +|--------------|----------| +| Batch Size | 192 | +| Learning Rate | AdamW with ReduceLROnPlateau | +| Epochs | 100 | +| Patience | 10 | +| Optimizer | AdamW | +| Scheduler | ReduceLROnPlateau | +| Image Size | 224x224 | +| Fine Tune Mode | half | +| Stochastic Depth Probability | 0.1 | + + +## πŸ“ˆ Training Curves + +![Combined Training Metrics](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/training_curves/PiT_combined_metrics.png) + + +## 🏁 Final Epoch Training Metrics + +| Metric | Training | Validation | +|:---------:|:-----------:|:-------------:| +| πŸ“‰ Loss | 0.1768 | 0.1241 | +| 🎯 Accuracy | 0.9266 | 0.9534 | +| πŸ“Š AUC-ROC | 0.9810 | 0.9902 | +| βš–οΈ F1 Score | 0.9263 | 0.9533 | + + +## β˜‘οΈ Evaluation Results + +### ROC Curves and Confusion Matrices + +Performance across all test datasets (a through l) in the Common Test Sample (More et al. 2024): + +![ROC + Confusion Matrix - Dataset A](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_a.png) +![ROC + Confusion Matrix - Dataset B](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_b.png) +![ROC + Confusion Matrix - Dataset C](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_c.png) +![ROC + Confusion Matrix - Dataset D](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_d.png) +![ROC + Confusion Matrix - Dataset E](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_e.png) +![ROC + Confusion Matrix - Dataset F](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_f.png) +![ROC + Confusion Matrix - Dataset G](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_g.png) +![ROC + Confusion Matrix - Dataset H](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_h.png) +![ROC + Confusion Matrix - Dataset I](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_i.png) +![ROC + Confusion Matrix - Dataset J](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_j.png) +![ROC + Confusion Matrix - Dataset K](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_k.png) +![ROC + Confusion Matrix - Dataset L](https://huggingface.co/parlange/pit-gravit-c2/resolve/main/roc_confusion_matrix/PiT_roc_confusion_matrix_l.png) + +### πŸ“‹ Performance Summary + +Average performance across 12 test datasets from the Common Test Sample (More et al. 2024): + +| Metric | Value | +|-----------|----------| +| 🎯 Average Accuracy | 0.8074 | +| πŸ“ˆ Average AUC-ROC | 0.8443 | +| βš–οΈ Average F1-Score | 0.5437 | + + +## πŸ“˜ Citation + +If you use this model in your research, please cite: + +```bibtex +@misc{parlange2025gravit, + title={GraViT: Transfer Learning with Vision Transformers and MLP-Mixer for Strong Gravitational Lens Discovery}, + author={RenΓ© Parlange and Juan C. Cuevas-Tello and Octavio Valenzuela and Omar de J. Cabrera-Rosas and TomΓ‘s Verdugo and Anupreeta More and Anton T. Jaelani}, + year={2025}, + eprint={2509.00226}, + archivePrefix={arXiv}, + primaryClass={cs.CV}, + url={https://arxiv.org/abs/2509.00226}, +} +``` + +--- + + +## Model Card Contact + +For questions about this model, please contact the author through: https://github.com/parlange/ diff --git a/config.json b/config.json new file mode 100644 index 0000000000000000000000000000000000000000..ca110c877d720cd07cd0a50041738146897edb77 --- /dev/null +++ b/config.json @@ -0,0 +1,76 @@ +{ + "architecture": "vit_base_patch16_224", + "num_classes": 2, + "num_features": 1000, + "global_pool": "avg", + "crop_pct": 0.875, + "interpolation": "bicubic", + "mean": [ + 0.485, + 0.456, + 0.406 + ], + "std": [ + 0.229, + 0.224, + 0.225 + ], + "first_conv": "conv1", + "classifier": "fc", + "input_size": [ + 3, + 224, + 224 + ], + "pool_size": [ + 7, + 7 + ], + "pretrained_cfg": { + "tag": "gravit_c2", + "custom_load": false, + "input_size": [ + 3, + 224, + 224 + ], + "fixed_input_size": true, + "interpolation": "bicubic", + "crop_pct": 0.875, + "crop_mode": "center", + "mean": [ + 0.485, + 0.456, + 0.406 + ], + "std": [ + 0.229, + 0.224, + 0.225 + ], + "num_classes": 2, + "pool_size": [ + 7, + 7 + ], + "first_conv": "conv1", + "classifier": "fc" + }, + "model_name": "pit_gravit_c2", + "experiment": "c2", + "training_strategy": "half", + "dataset": "C21+J24", + "hyperparameters": { + "batch_size": "192", + "learning_rate": "AdamW with ReduceLROnPlateau", + "epochs": "100", + "patience": "10", + "optimizer": "AdamW", + "scheduler": "ReduceLROnPlateau", + "image_size": "224x224", + "fine_tune_mode": "half", + "stochastic_depth_probability": "0.1" + }, + "hf_hub_id": "parlange/pit-gravit-c2", + "license": "apache-2.0" +} \ No newline at end of file diff --git a/confusion_matrices/PiT_Confusion_Matrix_a.png b/confusion_matrices/PiT_Confusion_Matrix_a.png new file mode 100644 index 0000000000000000000000000000000000000000..fcf063c9c29b277af46f1928a5a88f73e116be8f Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_a.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_b.png b/confusion_matrices/PiT_Confusion_Matrix_b.png new file mode 100644 index 0000000000000000000000000000000000000000..09893c7c3e6094bf638e22571d7d47b3f2d7f991 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_b.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_c.png b/confusion_matrices/PiT_Confusion_Matrix_c.png new file mode 100644 index 0000000000000000000000000000000000000000..4d563fc599dab1040ee9104bfc770c94966ed1de Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_c.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_d.png b/confusion_matrices/PiT_Confusion_Matrix_d.png new file mode 100644 index 0000000000000000000000000000000000000000..14c368b01436a56c5b15d8122366db4a0b320ec8 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_d.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_e.png b/confusion_matrices/PiT_Confusion_Matrix_e.png new file mode 100644 index 0000000000000000000000000000000000000000..0869180b69abb2cbe8c4a2a58d08e05d1e81bfa5 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_e.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_f.png b/confusion_matrices/PiT_Confusion_Matrix_f.png new file mode 100644 index 0000000000000000000000000000000000000000..2c0c26902fd17b4b19c38439f2e6fdc238a92c01 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_f.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_g.png b/confusion_matrices/PiT_Confusion_Matrix_g.png new file mode 100644 index 0000000000000000000000000000000000000000..97019445ebc2c46578cbb2913270329c070b07ae Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_g.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_h.png b/confusion_matrices/PiT_Confusion_Matrix_h.png new file mode 100644 index 0000000000000000000000000000000000000000..48d3c9fe33b4468f140e273767e06c237b07c1d7 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_h.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_i.png b/confusion_matrices/PiT_Confusion_Matrix_i.png new file mode 100644 index 0000000000000000000000000000000000000000..aa6d2de59ecc62fd7c7508fb0d89072fe3d5af90 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_i.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_j.png b/confusion_matrices/PiT_Confusion_Matrix_j.png new file mode 100644 index 0000000000000000000000000000000000000000..a5281ca1fe3a1f656e7dbdbcce8c602f0f140906 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_j.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_k.png b/confusion_matrices/PiT_Confusion_Matrix_k.png new file mode 100644 index 0000000000000000000000000000000000000000..c9278dc9b1d3861b6ce5c1f6bc160b8a055a1ee0 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_k.png differ diff --git a/confusion_matrices/PiT_Confusion_Matrix_l.png b/confusion_matrices/PiT_Confusion_Matrix_l.png new file mode 100644 index 0000000000000000000000000000000000000000..7f6d6a3849dc01ff24389013b06b37b6b735f6f4 Binary files /dev/null and b/confusion_matrices/PiT_Confusion_Matrix_l.png differ diff --git a/evaluation_results.csv b/evaluation_results.csv new file mode 100644 index 0000000000000000000000000000000000000000..51ad31002d20e48ac3ebf8b61b5b308068673ca5 --- /dev/null +++ b/evaluation_results.csv @@ -0,0 +1,133 @@ +Model,Dataset,Loss,Accuracy,AUCROC,F1 +ViT,a,0.35447569389258865,0.8949115044247787,0.9020846228498507,0.7480106100795756 +ViT,b,0.2228443425890036,0.9264382269726501,0.9263609576427256,0.5465116279069767 +ViT,c,0.46229862214933587,0.8349575605155611,0.8684438305709024,0.34944237918215615 +ViT,d,0.11673173789463115,0.9537881169443572,0.9704917127071824,0.6573426573426573 +ViT,e,0.3652098159562351,0.8825466520307355,0.920767426019829,0.7249357326478149 +ViT,f,0.24608832064126923,0.9108519842016175,0.9203345361214339,0.22926829268292684 +ViT,g,0.10483654439449311,0.9635,0.997473,0.9644999189495866 +ViT,h,0.23178722894191742,0.915,0.9939590555555555,0.9210526315789473 +ViT,i,0.04857917896906535,0.978,0.9990572222222223,0.9782966129562644 +ViT,j,2.494326035181681,0.6106666666666667,0.5831323333333334,0.42349457058242845 +ViT,k,2.4380686638752618,0.6251666666666666,0.7805802777777779,0.43278688524590164 +ViT,l,1.0272723743838732,0.8127329565949261,0.7993805230717175,0.7184308053873272 +MLP-Mixer,a,1.230455079964832,0.6227876106194691,0.8958911227772556,0.49028400597907323 +MLP-Mixer,b,1.0728926989350893,0.7004086765168186,0.9182900552486188,0.25604996096799376 +MLP-Mixer,c,1.374837134027586,0.5576862621817039,0.8979152854511969,0.18904899135446687 +MLP-Mixer,d,0.09552026474693218,0.9603898145237346,0.9868913443830571,0.7224669603524229 +MLP-Mixer,e,0.9593323631422711,0.7069154774972558,0.9188677817301143,0.5512605042016807 +MLP-Mixer,f,0.9257462782946794,0.7154410381794245,0.9306221006103087,0.09779367918902802 +MLP-Mixer,g,0.5643243643840155,0.8425,0.991425611111111,0.8635773061931572 +MLP-Mixer,h,0.7244052359660467,0.7668333333333334,0.9891666111111111,0.8104592873594364 +MLP-Mixer,i,0.04615406060218811,0.9803333333333333,0.9994367777777778,0.980655737704918 +MLP-Mixer,j,3.0292422666549683,0.45216666666666666,0.392282,0.28309705561613957 +MLP-Mixer,k,2.5110719747940697,0.59,0.7661271111111111,0.3453964874933475 +MLP-Mixer,l,1.4846716919555334,0.6762053625105207,0.7295511702036557,0.5855010004617516 +CvT,a,0.7465745627352621,0.6493362831858407,0.7317079694031161,0.4389380530973451 +CvT,b,0.7336456650122649,0.6765168186104998,0.7552670349907918,0.1942051683633516 +CvT,c,0.8642418710588097,0.5919522162841874,0.6964806629834255,0.16041397153945666 +CvT,d,0.06205783033066015,0.9761081420936812,0.9876427255985267,0.7654320987654321 +CvT,e,0.6019917449757506,0.7178924259055982,0.7936123514720351,0.4910891089108911 +CvT,f,0.5685286294680824,0.7414895617829603,0.8061353821076506,0.08274941608274941 +CvT,g,0.4509977758725484,0.8055,0.9201512777777776,0.8277999114652501 +CvT,h,0.5202355206807454,0.7606666666666667,0.9072719444444444,0.7961964235026966 +CvT,i,0.09494428576032321,0.9643333333333334,0.9977035555555557,0.9632554945054945 +CvT,j,2.988422914981842,0.3456666666666667,0.14668444444444442,0.022896963663514187 +CvT,k,2.6323694267769655,0.5045,0.6181494444444444,0.0300163132137031 +CvT,l,1.337245315202257,0.645425033064807,0.6032419706344807,0.5021944632005402 +Swin,a,0.47572549887463056,0.8407079646017699,0.905882487792577,0.6742081447963801 +Swin,b,0.24361524523634911,0.9163784973278843,0.9362615101289135,0.5283687943262412 +Swin,c,0.4370936370240709,0.8535051870480981,0.9087605893186003,0.3900523560209424 +Swin,d,0.038348094671021904,0.9880540710468406,0.9911620626151013,0.8869047619047619 +Swin,e,0.3579506372581067,0.8781558726673985,0.9260273972602739,0.7286063569682152 +Swin,f,0.24650774364781286,0.9156479217603912,0.9413092437445593,0.24937238493723848 +Swin,g,0.11494702147444089,0.9593333333333334,0.9989898888888888,0.9607969151670951 +Swin,h,0.2175228010714054,0.926,0.9979807777777777,0.9308841843088418 +Swin,i,0.006121216081082821,0.9973333333333333,0.9999798888888889,0.9973315543695798 +Swin,j,2.5422419211069744,0.5825,0.4893003333333333,0.3679031037093111 +Swin,k,2.433416116627554,0.6205,0.7913794999999999,0.39036144578313253 +Swin,l,1.035569912688268,0.8089455332451605,0.7797953948083542,0.7088143668682426 +CaiT,a,0.3509529214517205,0.9081858407079646,0.8966973093999068,0.7726027397260274 +CaiT,b,0.1907231829655279,0.9380697893744105,0.9234548802946593,0.5887265135699373 +CaiT,c,0.3048490960337163,0.90883370009431,0.8791160220994475,0.493006993006993 +CaiT,d,0.06549901952829443,0.9849104055328513,0.969243093922652,0.8545454545454545 +CaiT,e,0.31167979835318943,0.9187705817782656,0.9264058124574283,0.7921348314606742 +CaiT,f,0.1541684599891403,0.9499717886025955,0.9222261921687871,0.3464373464373464 +CaiT,g,0.07805611325552066,0.9708333333333333,0.9986172777777778,0.9714937286202965 +CaiT,h,0.13856186520308256,0.9553333333333334,0.997130611111111,0.9569961489088575 +CaiT,i,0.011666435472667217,0.9956666666666667,0.9999013333333333,0.9956594323873121 +CaiT,j,1.8389671653707822,0.6116666666666667,0.7423962222222222,0.4151606425702811 +CaiT,k,1.7725774958133698,0.6365,0.8888650555555555,0.4312907431551499 +CaiT,l,0.7395369254032035,0.8362991463268006,0.8693810723675515,0.7436693965922997 +DeiT,a,0.48058320357736234,0.8263274336283186,0.8941450218931248,0.6594360086767896 +DeiT,b,0.23002449519573911,0.9251807607670544,0.9313581952117864,0.5608856088560885 +DeiT,c,0.49494195908204974,0.8154668343288274,0.8907605893186004,0.34118967452300786 +DeiT,d,0.05036040664735698,0.9849104055328513,0.9769023941068141,0.8636363636363636 +DeiT,e,0.338863200106291,0.8792535675082327,0.9161961704382048,0.7342995169082126 +DeiT,f,0.26403015722496653,0.9037050968591311,0.9291450866890099,0.2289156626506024 +DeiT,g,0.10851164469867945,0.9641666666666666,0.9990410000000001,0.9653393519264872 +DeiT,h,0.2489620513096452,0.906,0.9981344444444444,0.9139194139194139 +DeiT,i,0.013259729760388533,0.9958333333333333,0.9998315555555556,0.9958423415932147 +DeiT,j,1.2026229511300723,0.7143333333333334,0.7246498888888889,0.6356292517006803 +DeiT,k,1.1073710439900557,0.746,0.8698901111111111,0.6623836951705804 +DeiT,l,0.5658274294531473,0.8476012985451485,0.867833726587774,0.7854785478547854 +DeiT3,a,0.39277621998196155,0.8661504424778761,0.9195532732705195,0.7125890736342043 +DeiT3,b,0.338128161960636,0.8824269097767997,0.9331012891344382,0.44510385756676557 +DeiT3,c,0.323060417608134,0.8883998742533794,0.922292817679558,0.4580152671755725 +DeiT3,d,0.12409640010358478,0.9553599497013517,0.9608121546961326,0.6787330316742082 +DeiT3,e,0.24973662732461413,0.9209659714599341,0.9483084840687203,0.8064516129032258 +DeiT3,f,0.2540075041596123,0.9116042881324055,0.9380772021883802,0.24193548387096775 +DeiT3,g,0.1656125110021482,0.9416666666666667,0.9990236666666666,0.944760101010101 +DeiT3,h,0.15762409150910875,0.9448333333333333,0.9990646111111111,0.9476017096723128 +DeiT3,i,0.05214000094247361,0.9803333333333333,0.9997376666666667,0.9806684141546527 +DeiT3,j,1.1591287109454473,0.696,0.7744774999999999,0.6248457424928013 +DeiT3,k,1.0456561943689981,0.7346666666666667,0.845634,0.6561555075593952 +DeiT3,l,0.5223108836063022,0.854033906456655,0.8898184372191467,0.7933968686181075 +Twins_SVT,a,0.4211153812640536,0.8307522123893806,0.8825833123189902,0.6433566433566433 +Twins_SVT,b,0.3625493723054758,0.8550770198050928,0.8962191528545118,0.37449118046132973 +Twins_SVT,c,0.47319920195681764,0.7868594781515247,0.8548139963167587,0.2893081761006289 +Twins_SVT,d,0.1203458983801289,0.9783087079534738,0.9818324125230202,0.8 +Twins_SVT,e,0.5213294555274637,0.7486278814489572,0.8316203738742148,0.5465346534653466 +Twins_SVT,f,0.3335461875583885,0.8666541282678202,0.9034523383543173,0.16292798110979928 +Twins_SVT,g,0.2639119902451833,0.9085,0.9744078888888889,0.912676952441546 +Twins_SVT,h,0.32257486327489215,0.8723333333333333,0.9662636666666669,0.8822263222632226 +Twins_SVT,i,0.13550377811988196,0.9738333333333333,0.9972788888888889,0.9733672603901612 +Twins_SVT,j,1.2430085968176523,0.49,0.43771377777777776,0.1896186440677966 +Twins_SVT,k,1.1146003757913907,0.5553333333333333,0.7234002222222222,0.2115839243498818 +Twins_SVT,l,0.6286477774643219,0.7480461704941685,0.7275090480198628,0.6162439337057046 +Twins_PCPVT,a,0.45601994748664115,0.7699115044247787,0.8394007473464615,0.5458515283842795 +Twins_PCPVT,b,0.3125818614145001,0.8773970449544168,0.9010699815837937,0.390625 +Twins_PCPVT,c,0.5049686531944119,0.7500785916378497,0.8135911602209945,0.23923444976076555 +Twins_PCPVT,d,0.3149096430453517,0.8918579063187677,0.9015690607734806,0.4208754208754209 +Twins_PCPVT,e,0.42039827045572575,0.8079034028540066,0.8655339438431847,0.5882352941176471 +Twins_PCPVT,f,0.3770137148085496,0.8412638706037239,0.8693597175042401,0.12899896800825594 +Twins_PCPVT,g,0.2785677030881246,0.9015,0.9626754444444443,0.9027480664801711 +Twins_PCPVT,h,0.3805647597312927,0.834,0.928301,0.8463437210737427 +Twins_PCPVT,i,0.2798018006483714,0.9091666666666667,0.9656723333333334,0.9096335599403084 +Twins_PCPVT,j,0.614702238559723,0.6835,0.7995154444444446,0.6018033130635353 +Twins_PCPVT,k,0.6159363424777985,0.6911666666666667,0.7903985,0.6076646199449502 +Twins_PCPVT,l,0.45535326129802217,0.7889864133702056,0.8498913163479216,0.7103004291845494 +PiT,a,0.3937257931823224,0.8296460176991151,0.8874127904755356,0.641860465116279 +PiT,b,0.2796248870145521,0.8777114115058158,0.91848802946593,0.4150375939849624 +PiT,c,0.5313189482209218,0.7613957874882112,0.8498581952117863,0.26666666666666666 +PiT,d,0.049343678185640734,0.9798805407104684,0.9911620626151012,0.8117647058823529 +PiT,e,0.3259278782832505,0.8518111964873765,0.9145841216983274,0.6715328467153284 +PiT,f,0.2841162405192056,0.8750235094978371,0.9172267022129574,0.17196261682242991 +PiT,g,0.1590204114516576,0.9338333333333333,0.9916004444444445,0.9369340746624305 +PiT,h,0.2924602138201396,0.8721666666666666,0.981646111111111,0.8849212303075769 +PiT,i,0.03693298858900865,0.988,0.999485,0.9879396984924623 +PiT,j,2.9977854507366817,0.461,0.277717,0.06477732793522267 +PiT,k,2.8756980224698783,0.5151666666666667,0.7229978888888889,0.07149696776252792 +PiT,l,1.2244331041709067,0.7434170975111218,0.6790239785353327,0.599849990624414 +Ensemble,a,,0.9070796460176991,0.941851401847734,0.79 +Ensemble,b,,0.9374410562716127,0.9600349907918969,0.6135922330097088 +Ensemble,c,,0.895001571832757,0.9307624309392265,0.48615384615384616 +Ensemble,d,,0.9911977365608299,0.9944677716390424,0.9186046511627907 +Ensemble,e,,0.9264544456641054,0.955384848255506,0.825065274151436 +Ensemble,f,,0.941696445363927,0.9599335198386041,0.33760683760683763 +Ensemble,g,,0.9701666666666666,0.9990522222222222,0.9710027539283979 +Ensemble,h,,0.9476666666666667,0.9979163333333333,0.9502219403931516 +Ensemble,i,,0.9986666666666667,0.9999886666666667,0.9986671109630123 +Ensemble,j,,0.5698333333333333,0.6426453333333333,0.31556616282153277 +Ensemble,k,,0.5983333333333334,0.8897323333333333,0.33055555555555555 +Ensemble,l,,0.8179632078874595,0.832089495815299,0.712386018237082 diff --git a/model.safetensors b/model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..8b2a6a2a95f789a6215177252c9b437bc324b81b --- /dev/null +++ b/model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:32fb6c4540f07c780b611960417a6e5c764d63415407070bfb0afcddcd3dea7e +size 290985688 diff --git a/pit-gravit-c2.pth b/pit-gravit-c2.pth new file mode 100644 index 0000000000000000000000000000000000000000..87b380669672d2fb02b37047a495b6bbe77f6730 --- /dev/null +++ b/pit-gravit-c2.pth @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:610198bdc074942f3128395ac2af223bc5692124344e78135ce9e033f2540fab +size 291039882 diff --git a/pytorch_model.bin b/pytorch_model.bin new file mode 100644 index 0000000000000000000000000000000000000000..87b380669672d2fb02b37047a495b6bbe77f6730 --- /dev/null +++ b/pytorch_model.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:610198bdc074942f3128395ac2af223bc5692124344e78135ce9e033f2540fab +size 291039882 diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_a.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_a.png new file mode 100644 index 0000000000000000000000000000000000000000..400f78a14a22cdbad47f3d892f37a6129bf22b96 Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_a.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_b.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_b.png new file mode 100644 index 0000000000000000000000000000000000000000..8cd8bdeac9d362d3bdf49b8bf58482d95fac419e Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_b.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_c.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_c.png new file mode 100644 index 0000000000000000000000000000000000000000..41057d25756252d859af552e0118d30ddedbd95e Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_c.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_d.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_d.png new file mode 100644 index 0000000000000000000000000000000000000000..ef886522085103df212fa6c3aac199759ad1bb35 Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_d.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_e.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_e.png new file mode 100644 index 0000000000000000000000000000000000000000..c6232a007bd3c62880a9d8ea65a85b17d816e89f Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_e.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_f.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_f.png new file mode 100644 index 0000000000000000000000000000000000000000..e28c911e1107f98a3a273326afd91b97a48c8900 Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_f.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_g.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_g.png new file mode 100644 index 0000000000000000000000000000000000000000..456af82b3fab897b2f44c9069f08c20bd48e9a02 Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_g.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_h.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_h.png new file mode 100644 index 0000000000000000000000000000000000000000..e8c16a53736ba5480987d8333a1683eea89b455a Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_h.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_i.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_i.png new file mode 100644 index 0000000000000000000000000000000000000000..726f2617d67b4e9f1759df53bc215d5dac36d690 Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_i.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_j.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_j.png new file mode 100644 index 0000000000000000000000000000000000000000..1f58cdc334895ba7308e7291ee37abd27c5c9e6c Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_j.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_k.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_k.png new file mode 100644 index 0000000000000000000000000000000000000000..4d6c3ab848cc33cb2985c3b49f278b6bdb0cbbfb Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_k.png differ diff --git a/roc_confusion_matrix/PiT_roc_confusion_matrix_l.png b/roc_confusion_matrix/PiT_roc_confusion_matrix_l.png new file mode 100644 index 0000000000000000000000000000000000000000..ccb963d0c98d2a3999216e9e4e51b6b384daada0 Binary files /dev/null and b/roc_confusion_matrix/PiT_roc_confusion_matrix_l.png differ diff --git a/roc_curves/PiT_ROC_a.png b/roc_curves/PiT_ROC_a.png new file mode 100644 index 0000000000000000000000000000000000000000..6c0e9f4d02bc2f6d4f5f3dfc0842c4cccd4d80d3 Binary files /dev/null and b/roc_curves/PiT_ROC_a.png differ diff --git a/roc_curves/PiT_ROC_b.png b/roc_curves/PiT_ROC_b.png new file mode 100644 index 0000000000000000000000000000000000000000..cdde535c2898b67589c1d315713c380d0530cb8f Binary files /dev/null and b/roc_curves/PiT_ROC_b.png differ diff --git a/roc_curves/PiT_ROC_c.png b/roc_curves/PiT_ROC_c.png new file mode 100644 index 0000000000000000000000000000000000000000..1d324d81315d7a84a7b6b0f49bbdbb45618af1cf Binary files /dev/null and b/roc_curves/PiT_ROC_c.png differ diff --git a/roc_curves/PiT_ROC_d.png b/roc_curves/PiT_ROC_d.png new file mode 100644 index 0000000000000000000000000000000000000000..ca90263b74f96e470bf236a1cb86899f797cd8cf Binary files /dev/null and b/roc_curves/PiT_ROC_d.png differ diff --git a/roc_curves/PiT_ROC_e.png b/roc_curves/PiT_ROC_e.png new file mode 100644 index 0000000000000000000000000000000000000000..aa5245cb384dc3960824c04c05e37c1b90b68bdb Binary files /dev/null and b/roc_curves/PiT_ROC_e.png differ diff --git a/roc_curves/PiT_ROC_f.png b/roc_curves/PiT_ROC_f.png new file mode 100644 index 0000000000000000000000000000000000000000..6d1c72b7d456fa609c2b43dd6d431fbfacf6a14a Binary files /dev/null and b/roc_curves/PiT_ROC_f.png differ diff --git a/roc_curves/PiT_ROC_g.png b/roc_curves/PiT_ROC_g.png new file mode 100644 index 0000000000000000000000000000000000000000..b48f756b989e7fcd8b733f6ddc4a4cca4d81727b Binary files /dev/null and b/roc_curves/PiT_ROC_g.png differ diff --git a/roc_curves/PiT_ROC_h.png b/roc_curves/PiT_ROC_h.png new file mode 100644 index 0000000000000000000000000000000000000000..dce1ecb0dab7d4b7876fb3034e68ff6b640c9866 Binary files /dev/null and b/roc_curves/PiT_ROC_h.png differ diff --git a/roc_curves/PiT_ROC_i.png b/roc_curves/PiT_ROC_i.png new file mode 100644 index 0000000000000000000000000000000000000000..52ea782e26b0082fa729bea3b19b34c251ce6899 Binary files /dev/null and b/roc_curves/PiT_ROC_i.png differ diff --git a/roc_curves/PiT_ROC_j.png b/roc_curves/PiT_ROC_j.png new file mode 100644 index 0000000000000000000000000000000000000000..f58b4b93580e025509c1d60b349324174d547dbb Binary files /dev/null and b/roc_curves/PiT_ROC_j.png differ diff --git a/roc_curves/PiT_ROC_k.png b/roc_curves/PiT_ROC_k.png new file mode 100644 index 0000000000000000000000000000000000000000..4574d09fd11f06bec5ff05c95f36952548dd8be3 Binary files /dev/null and b/roc_curves/PiT_ROC_k.png differ diff --git a/roc_curves/PiT_ROC_l.png b/roc_curves/PiT_ROC_l.png new file mode 100644 index 0000000000000000000000000000000000000000..1ab7910793fcf38a23f6c3958930bd8143dbf158 Binary files /dev/null and b/roc_curves/PiT_ROC_l.png differ diff --git a/training_curves/PiT_accuracy.png b/training_curves/PiT_accuracy.png new file mode 100644 index 0000000000000000000000000000000000000000..2c82abf531a837bf402f28a080f467c870991563 Binary files /dev/null and b/training_curves/PiT_accuracy.png differ diff --git a/training_curves/PiT_auc.png b/training_curves/PiT_auc.png new file mode 100644 index 0000000000000000000000000000000000000000..2128b11d2ae2970df3936c5f84069d54ebe71f1f Binary files /dev/null and b/training_curves/PiT_auc.png differ diff --git a/training_curves/PiT_combined_metrics.png b/training_curves/PiT_combined_metrics.png new file mode 100644 index 0000000000000000000000000000000000000000..00b64b5fd45f01f32706bdb17164dafd24aca2e3 --- /dev/null +++ b/training_curves/PiT_combined_metrics.png @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9e835ba6293ac0c0be4d9dd939a4de027b7225fcfc9438ddbb4b782f4cc7067b +size 158430 diff --git a/training_curves/PiT_f1.png b/training_curves/PiT_f1.png new file mode 100644 index 0000000000000000000000000000000000000000..de1137ad75b60687ac5b28b2270c051444f2f41d Binary files /dev/null and b/training_curves/PiT_f1.png differ diff --git a/training_curves/PiT_loss.png b/training_curves/PiT_loss.png new file mode 100644 index 0000000000000000000000000000000000000000..275f201ca1de289ee87796d8df9220e821bcb531 Binary files /dev/null and b/training_curves/PiT_loss.png differ diff --git a/training_curves/PiT_metrics.csv b/training_curves/PiT_metrics.csv new file mode 100644 index 0000000000000000000000000000000000000000..16abe60919436bdbdca4d7c45ba2715a5ee72b4e --- /dev/null +++ b/training_curves/PiT_metrics.csv @@ -0,0 +1,79 @@ +epoch,train_loss,val_loss,train_accuracy,val_accuracy,train_auc,val_auc,train_f1,val_f1 +1,0.36233020514299746,0.29970101251894116,0.8383384068132845,0.8709912536443148,0.9196018811517546,0.9604002158964379,0.8387575478456657,0.88 +2,0.2789034600516703,0.2393716046744116,0.8829821801142388,0.9037900874635568,0.9529643326162407,0.9694663788047497,0.8823332158241833,0.9074333800841514 +3,0.2593451212059152,0.20805626486376494,0.8912850155624722,0.9198250728862973,0.9592965369511129,0.9765743865226224,0.8906585940590653,0.9217638691322901 +4,0.24514418407088653,0.19002231221331103,0.8979033416561206,0.923469387755102,0.9636186699065337,0.9771683142228154,0.8973609559013153,0.922509225092251 +5,0.2394631020257153,0.17069047450497965,0.8997845196155556,0.9336734693877551,0.9651783712893223,0.9818506744638714,0.8992451986726501,0.9324424647364514 +6,0.23080718357165805,0.24374222516492228,0.9044190580428909,0.8965014577259475,0.9676906088606333,0.9805076966230057,0.903995465164216,0.8865814696485623 +7,0.22450651501304095,0.17771336192987403,0.9064883537982693,0.9314868804664723,0.9693469276281166,0.9802898877168528,0.905988343104723,0.9321789321789322 +8,0.21979985898629778,0.17595275024457158,0.9086944624961522,0.934402332361516,0.9705851395657841,0.9828015962736614,0.9082661809934537,0.9356223175965666 +9,0.21516496794928433,0.1790100717727019,0.9112426035502958,0.9314868804664723,0.9718440235380357,0.9838619537777628,0.9108078846517383,0.9335219236209336 +10,0.21452437499363183,0.17893647717491185,0.9108663679584089,0.9285714285714286,0.9719583923985107,0.9853281795850368,0.9103219257041587,0.9247311827956989 +11,0.20754402267739014,0.17404167527881378,0.9134914662927113,0.9307580174927114,0.9737529269184622,0.9835400215896437,0.9130700028355144,0.931899641577061 +12,0.19780038125214403,0.1418822090584057,0.9193316687758663,0.9467930029154519,0.9763044930341069,0.987497768786815,0.9189658134341179,0.9460458240946046 +13,0.1934141220649967,0.14139472395616093,0.9206741457741903,0.9467930029154519,0.9773581883014619,0.9875806424194001,0.9202095177479422,0.9467541940189642 +14,0.1934208858461457,0.139229262144503,0.9201268940041728,0.9453352769679301,0.9773056264320266,0.9878207634574029,0.9197708474692731,0.9452154857560263 +15,0.19074950850326525,0.1402430695104182,0.922324451893149,0.9460641399416909,0.9779107379347325,0.9874095827418847,0.921859408870385,0.9455081001472754 +16,0.19173615694547533,0.13882749668884556,0.9207083490098164,0.9467930029154519,0.9776180775285328,0.9877835765709866,0.9202301994890191,0.9460458240946046 +17,0.191168249241059,0.13754117918952907,0.920964873277012,0.9453352769679301,0.9777927338764157,0.9879004496425808,0.9206030150753769,0.9448123620309051 +18,0.18873048595214878,0.13981756654842253,0.9223586551287751,0.9453352769679301,0.9783731073452622,0.9876592661221089,0.9219179966978536,0.9444855662472242 +19,0.19039970816815727,0.13393708690457892,0.9230683722680165,0.9511661807580175,0.9779171543316474,0.988471002728455,0.9227387096497179,0.9508437270726339 +20,0.1886889381845701,0.13384573848011194,0.9220422751992339,0.9467930029154519,0.9783297421944188,0.9887684978197859,0.9216099326758553,0.9469090909090909 +21,0.18851448938861634,0.13450837917300076,0.9226750350583165,0.9489795918367347,0.9784135740184345,0.9883286300776035,0.9222702619070131,0.948301329394387 +22,0.18751028372420084,0.1397644239681455,0.9226750350583165,0.9438775510204082,0.9785963369203852,0.9883350049724179,0.922244864618533,0.9444844989185291 +23,0.18757704842560316,0.13256130466351704,0.9234873619044361,0.9482507288629738,0.9785667280226568,0.9887908099516357,0.9230848576536927,0.9478324761204996 +24,0.18770277607335753,0.1357979845505414,0.9227263399117557,0.9460641399416909,0.9785498741229798,0.9884688777635169,0.9221974464714644,0.9460641399416909 +25,0.1863581392493963,0.1353398425933571,0.9238037418339775,0.9482507288629738,0.9788793404137933,0.9885124395447475,0.9234364662720064,0.9483636363636364 +26,0.18420615110185887,0.14155046685270248,0.9249837534630776,0.9424198250728864,0.9793952761659406,0.9878866373704833,0.924578099880501,0.9428778018799711 +27,0.18581719516048345,0.13698511442533387,0.9237267845538187,0.9467930029154519,0.9789779452466503,0.9884996897551189,0.9234058630579265,0.9470630891950689 +28,0.18425983067184118,0.13252408906773994,0.9248811437561993,0.9475218658892128,0.9793347893634089,0.9887865600217596,0.9244580499256189,0.947136563876652 +29,0.18495915091218784,0.13212353425540313,0.9241115709546123,0.9467930029154519,0.9791665277700061,0.9892391775535703,0.9236998890961768,0.9469090909090909 +30,0.18430970521423262,0.12890243684498284,0.9239833088210144,0.9511661807580175,0.9793424826639624,0.9893231136686245,0.9236280540187622,0.9506990434142752 +31,0.1838982511615914,0.13194029050561498,0.924940999418545,0.9482507288629738,0.9794280160512789,0.9888630587595305,0.9246083550913838,0.9475240206947524 +32,0.18290547842928384,0.13082542394236296,0.9243253411772754,0.9504373177842566,0.979600852387402,0.9890351809195148,0.9239494715132767,0.9501466275659824 +33,0.18369765012185232,0.12840869347225473,0.9252744809658994,0.9533527696793003,0.9794289731440773,0.9894197995733071,0.9248587716356695,0.9528718703976435 +34,0.18320441776851862,0.13257058870601238,0.9256592673666929,0.9460641399416909,0.9795751438073387,0.9891520539911092,0.9252733273739944,0.9462209302325582 +35,0.17985989359902607,0.13369113070016003,0.9266768136265691,0.9467930029154519,0.9803058469426976,0.9887408732755909,0.92638031542708,0.9469862018881626 +36,0.18242066704542312,0.1306314041333018,0.9257362246468516,0.9497084548104956,0.9797273287276838,0.9891849909476493,0.9253538921692495,0.9498181818181818 +37,0.18303082494583306,0.13051823008555713,0.9251804220679276,0.9518950437317785,0.9795625560994569,0.989337988423191,0.9248423837419044,0.9511111111111111 +38,0.18136139805610413,0.12837442981605976,0.9255652084687211,0.9518950437317785,0.9799693281428723,0.9896046715229199,0.9251562647774463,0.9512555391432792 +39,0.18148975201810144,0.1306429403907356,0.9260697061942059,0.9467930029154519,0.9799571759158697,0.9891446166138258,0.9257305822323776,0.9461254612546125 +40,0.17934676769857233,0.14537533867897862,0.9271129048808017,0.9409620991253644,0.9804232608059748,0.9883530671743915,0.9267886283603882,0.9420186113099499 +41,0.17940764591583544,0.12568791645087585,0.9262407223723365,0.9518950437317785,0.9803314559383155,0.9898331052537633,0.9258794617539398,0.9516837481698389 +42,0.18107056629153379,0.13271132343972739,0.9263176796524951,0.9467930029154519,0.9799676722041636,0.9894219245382452,0.9259459784635745,0.9472924187725632 +43,0.17952147694171752,0.12523162727713932,0.9267024660532887,0.9518950437317785,0.9803587872622723,0.989962728114986,0.9263282740601956,0.9516129032258065 +44,0.1808621069753358,0.12804140719658433,0.926642610390943,0.9511661807580175,0.980039486042764,0.9895685471189726,0.9262674791367649,0.9509875640087784 +45,0.17865849226533778,0.12606683558086612,0.9270958032629887,0.9504373177842566,0.9805542058702942,0.9897130447347618,0.9267122816668959,0.9502196193265008 +46,0.17709277664536216,0.12949952900235925,0.9284040770256866,0.9518950437317785,0.9808630989798061,0.989336925940722,0.9280750431652822,0.9518950437317785 +47,0.1776126382921709,0.13869572819669462,0.9277285631220713,0.9453352769679301,0.9807427155697823,0.9896365459969911,0.9273496192129829,0.9463902787705504 +48,0.17726845076405065,0.1274495993254831,0.9266853644354756,0.9518950437317785,0.9808809555968733,0.9895111730656443,0.9263110851367379,0.9516837481698389 +49,0.17738705108885555,0.1285623211858919,0.9273694291479974,0.9489795918367347,0.9808116394122064,0.9895122355481135,0.9270700965071951,0.9489795918367347 +50,0.17664882755782685,0.1259572171435064,0.92741218319253,0.9540816326530612,0.9809636039599241,0.989799105814754,0.9269819970926982,0.9539810080350621 +51,0.17600744828802498,0.12716585508501566,0.9278055204022301,0.9497084548104956,0.9811120241202851,0.9897969808498159,0.9273901564340938,0.9498910675381264 +52,0.17542210658560187,0.12426498649592997,0.9281390019495844,0.9540816326530612,0.9812825283378522,0.990067913879421,0.9276764199655766,0.9539810080350621 +53,0.1766666979093038,0.12476968452464735,0.9278568252556691,0.9533527696793003,0.9810123785495447,0.9900339144404118,0.9274554818961144,0.9532846715328467 +54,0.17660799297673369,0.126970670748035,0.9284981359236584,0.9504373177842566,0.9809859233054894,0.9900456017475712,0.9280849014413981,0.9506531204644412 +55,0.17558396369189266,0.12640303398316874,0.9275318945172213,0.9504373177842566,0.9812259422916837,0.9899691030098002,0.9271362616388538,0.9505813953488372 +56,0.17395585639141128,0.1250900527565542,0.9286263980572562,0.9526239067055393,0.9815714387535673,0.9900572890547306,0.9282897619395356,0.9526584122359796 +57,0.17536393163912592,0.12370957225648029,0.9280962479050519,0.9533527696793003,0.9812844947285105,0.9901571624068203,0.9277074252701623,0.9532846715328467 +58,0.17566584592891074,0.12333806076306991,0.9286092964394431,0.9526239067055393,0.9811826397284211,0.9901699121964488,0.9281899109792285,0.9524506217995611 +59,0.17558764315387043,0.1256001479163462,0.9283527721722475,0.9526239067055393,0.9812124197183688,0.98995847818511,0.9279839104762396,0.9525893508388038 +60,0.17575680659326715,0.12565061119765195,0.9283100181277149,0.9518950437317785,0.9811708919809725,0.9900307269930045,0.9279762211569851,0.9518950437317785 +61,0.17540902452454887,0.12461533680905754,0.9288059650442931,0.9518950437317785,0.9812550357192646,0.9901051007658375,0.9284179032618601,0.9518950437317785 +62,0.17541102996259683,0.12432444899318518,0.9282245100386497,0.9533527696793003,0.9812681197408146,0.990126350415218,0.9278270738753611,0.9532846715328467 +63,0.1749994034859829,0.12393498219245551,0.9283100181277149,0.9533527696793003,0.9813248757093408,0.990092350976209,0.9279527017736835,0.9532846715328467 +64,0.17485610548442898,0.12386349512606251,0.9280620446694258,0.9533527696793003,0.9813954807887251,0.9902049741179271,0.9277215048497813,0.9532846715328467 +65,0.1759885422194563,0.12439083941172233,0.92741218319253,0.9533527696793003,0.9811308063901275,0.9901656622665727,0.9270810964034463,0.9532846715328467 +66,0.1759207148018135,0.12433676582383693,0.9277542155487909,0.9533527696793003,0.9811570319026647,0.9901645997841035,0.9273473037930056,0.9532846715328467 +67,0.17424281581552825,0.12447478372397297,0.9291736498272737,0.9533527696793003,0.9815324444971079,0.9901242254502801,0.9287453223794572,0.9532846715328467 +68,0.17385396183986573,0.12418095758809293,0.9288914731333584,0.9533527696793003,0.9815897931466292,0.9901380377223776,0.9286033174216147,0.9532846715328467 +69,0.1750469607995702,0.12394943818145869,0.9287119061463215,0.9533527696793003,0.9813509181385803,0.9901422876522538,0.9283941286105696,0.9532846715328467 +70,0.17642186737588156,0.12356808784882112,0.9287888634264801,0.9533527696793003,0.9810236544041807,0.9901922243282987,0.9284695858313435,0.9532846715328467 +71,0.17437013022288922,0.12374842514449584,0.9286007456305366,0.9533527696793003,0.9815056148974278,0.9901752246087939,0.928130002926443,0.9532846715328467 +72,0.1753760602373747,0.12390452723287633,0.9293446660054041,0.9533527696793003,0.9812637434358219,0.9901667247490417,0.9289026940053863,0.9532846715328467 +73,0.17607059463969202,0.12404029848971798,0.9281732051852105,0.9533527696793003,0.9811083219478821,0.9901656622665727,0.9277854195323246,0.9532846715328467 +74,0.17546011868152164,0.12413608482645135,0.9286434996750692,0.9533527696793003,0.9812536699061651,0.9901624748191655,0.9282440647652132,0.9532846715328467 +75,0.17476058825221047,0.12416948035424548,0.9283356705544344,0.9533527696793003,0.9814359636937233,0.9901592873717584,0.9279109574312526,0.9532846715328467 +76,0.1753198992475364,0.12414770433271939,0.9284639326880323,0.9533527696793003,0.9812443771127117,0.9901614123366964,0.9280950252690205,0.9532846715328467 +77,0.1746743339889128,0.12415588093221014,0.9289085747511715,0.9533527696793003,0.9814541446548435,0.9901603498542274,0.9285087794727157,0.9532846715328467 +78,0.17683591671265333,0.12414996087029793,0.9266084071553169,0.9533527696793003,0.9809634792234599,0.9901635373016345,0.9262951799469304,0.9532846715328467 diff --git a/training_metrics.csv b/training_metrics.csv new file mode 100644 index 0000000000000000000000000000000000000000..16abe60919436bdbdca4d7c45ba2715a5ee72b4e --- /dev/null +++ b/training_metrics.csv @@ -0,0 +1,79 @@ +epoch,train_loss,val_loss,train_accuracy,val_accuracy,train_auc,val_auc,train_f1,val_f1 +1,0.36233020514299746,0.29970101251894116,0.8383384068132845,0.8709912536443148,0.9196018811517546,0.9604002158964379,0.8387575478456657,0.88 +2,0.2789034600516703,0.2393716046744116,0.8829821801142388,0.9037900874635568,0.9529643326162407,0.9694663788047497,0.8823332158241833,0.9074333800841514 +3,0.2593451212059152,0.20805626486376494,0.8912850155624722,0.9198250728862973,0.9592965369511129,0.9765743865226224,0.8906585940590653,0.9217638691322901 +4,0.24514418407088653,0.19002231221331103,0.8979033416561206,0.923469387755102,0.9636186699065337,0.9771683142228154,0.8973609559013153,0.922509225092251 +5,0.2394631020257153,0.17069047450497965,0.8997845196155556,0.9336734693877551,0.9651783712893223,0.9818506744638714,0.8992451986726501,0.9324424647364514 +6,0.23080718357165805,0.24374222516492228,0.9044190580428909,0.8965014577259475,0.9676906088606333,0.9805076966230057,0.903995465164216,0.8865814696485623 +7,0.22450651501304095,0.17771336192987403,0.9064883537982693,0.9314868804664723,0.9693469276281166,0.9802898877168528,0.905988343104723,0.9321789321789322 +8,0.21979985898629778,0.17595275024457158,0.9086944624961522,0.934402332361516,0.9705851395657841,0.9828015962736614,0.9082661809934537,0.9356223175965666 +9,0.21516496794928433,0.1790100717727019,0.9112426035502958,0.9314868804664723,0.9718440235380357,0.9838619537777628,0.9108078846517383,0.9335219236209336 +10,0.21452437499363183,0.17893647717491185,0.9108663679584089,0.9285714285714286,0.9719583923985107,0.9853281795850368,0.9103219257041587,0.9247311827956989 +11,0.20754402267739014,0.17404167527881378,0.9134914662927113,0.9307580174927114,0.9737529269184622,0.9835400215896437,0.9130700028355144,0.931899641577061 +12,0.19780038125214403,0.1418822090584057,0.9193316687758663,0.9467930029154519,0.9763044930341069,0.987497768786815,0.9189658134341179,0.9460458240946046 +13,0.1934141220649967,0.14139472395616093,0.9206741457741903,0.9467930029154519,0.9773581883014619,0.9875806424194001,0.9202095177479422,0.9467541940189642 +14,0.1934208858461457,0.139229262144503,0.9201268940041728,0.9453352769679301,0.9773056264320266,0.9878207634574029,0.9197708474692731,0.9452154857560263 +15,0.19074950850326525,0.1402430695104182,0.922324451893149,0.9460641399416909,0.9779107379347325,0.9874095827418847,0.921859408870385,0.9455081001472754 +16,0.19173615694547533,0.13882749668884556,0.9207083490098164,0.9467930029154519,0.9776180775285328,0.9877835765709866,0.9202301994890191,0.9460458240946046 +17,0.191168249241059,0.13754117918952907,0.920964873277012,0.9453352769679301,0.9777927338764157,0.9879004496425808,0.9206030150753769,0.9448123620309051 +18,0.18873048595214878,0.13981756654842253,0.9223586551287751,0.9453352769679301,0.9783731073452622,0.9876592661221089,0.9219179966978536,0.9444855662472242 +19,0.19039970816815727,0.13393708690457892,0.9230683722680165,0.9511661807580175,0.9779171543316474,0.988471002728455,0.9227387096497179,0.9508437270726339 +20,0.1886889381845701,0.13384573848011194,0.9220422751992339,0.9467930029154519,0.9783297421944188,0.9887684978197859,0.9216099326758553,0.9469090909090909 +21,0.18851448938861634,0.13450837917300076,0.9226750350583165,0.9489795918367347,0.9784135740184345,0.9883286300776035,0.9222702619070131,0.948301329394387 +22,0.18751028372420084,0.1397644239681455,0.9226750350583165,0.9438775510204082,0.9785963369203852,0.9883350049724179,0.922244864618533,0.9444844989185291 +23,0.18757704842560316,0.13256130466351704,0.9234873619044361,0.9482507288629738,0.9785667280226568,0.9887908099516357,0.9230848576536927,0.9478324761204996 +24,0.18770277607335753,0.1357979845505414,0.9227263399117557,0.9460641399416909,0.9785498741229798,0.9884688777635169,0.9221974464714644,0.9460641399416909 +25,0.1863581392493963,0.1353398425933571,0.9238037418339775,0.9482507288629738,0.9788793404137933,0.9885124395447475,0.9234364662720064,0.9483636363636364 +26,0.18420615110185887,0.14155046685270248,0.9249837534630776,0.9424198250728864,0.9793952761659406,0.9878866373704833,0.924578099880501,0.9428778018799711 +27,0.18581719516048345,0.13698511442533387,0.9237267845538187,0.9467930029154519,0.9789779452466503,0.9884996897551189,0.9234058630579265,0.9470630891950689 +28,0.18425983067184118,0.13252408906773994,0.9248811437561993,0.9475218658892128,0.9793347893634089,0.9887865600217596,0.9244580499256189,0.947136563876652 +29,0.18495915091218784,0.13212353425540313,0.9241115709546123,0.9467930029154519,0.9791665277700061,0.9892391775535703,0.9236998890961768,0.9469090909090909 +30,0.18430970521423262,0.12890243684498284,0.9239833088210144,0.9511661807580175,0.9793424826639624,0.9893231136686245,0.9236280540187622,0.9506990434142752 +31,0.1838982511615914,0.13194029050561498,0.924940999418545,0.9482507288629738,0.9794280160512789,0.9888630587595305,0.9246083550913838,0.9475240206947524 +32,0.18290547842928384,0.13082542394236296,0.9243253411772754,0.9504373177842566,0.979600852387402,0.9890351809195148,0.9239494715132767,0.9501466275659824 +33,0.18369765012185232,0.12840869347225473,0.9252744809658994,0.9533527696793003,0.9794289731440773,0.9894197995733071,0.9248587716356695,0.9528718703976435 +34,0.18320441776851862,0.13257058870601238,0.9256592673666929,0.9460641399416909,0.9795751438073387,0.9891520539911092,0.9252733273739944,0.9462209302325582 +35,0.17985989359902607,0.13369113070016003,0.9266768136265691,0.9467930029154519,0.9803058469426976,0.9887408732755909,0.92638031542708,0.9469862018881626 +36,0.18242066704542312,0.1306314041333018,0.9257362246468516,0.9497084548104956,0.9797273287276838,0.9891849909476493,0.9253538921692495,0.9498181818181818 +37,0.18303082494583306,0.13051823008555713,0.9251804220679276,0.9518950437317785,0.9795625560994569,0.989337988423191,0.9248423837419044,0.9511111111111111 +38,0.18136139805610413,0.12837442981605976,0.9255652084687211,0.9518950437317785,0.9799693281428723,0.9896046715229199,0.9251562647774463,0.9512555391432792 +39,0.18148975201810144,0.1306429403907356,0.9260697061942059,0.9467930029154519,0.9799571759158697,0.9891446166138258,0.9257305822323776,0.9461254612546125 +40,0.17934676769857233,0.14537533867897862,0.9271129048808017,0.9409620991253644,0.9804232608059748,0.9883530671743915,0.9267886283603882,0.9420186113099499 +41,0.17940764591583544,0.12568791645087585,0.9262407223723365,0.9518950437317785,0.9803314559383155,0.9898331052537633,0.9258794617539398,0.9516837481698389 +42,0.18107056629153379,0.13271132343972739,0.9263176796524951,0.9467930029154519,0.9799676722041636,0.9894219245382452,0.9259459784635745,0.9472924187725632 +43,0.17952147694171752,0.12523162727713932,0.9267024660532887,0.9518950437317785,0.9803587872622723,0.989962728114986,0.9263282740601956,0.9516129032258065 +44,0.1808621069753358,0.12804140719658433,0.926642610390943,0.9511661807580175,0.980039486042764,0.9895685471189726,0.9262674791367649,0.9509875640087784 +45,0.17865849226533778,0.12606683558086612,0.9270958032629887,0.9504373177842566,0.9805542058702942,0.9897130447347618,0.9267122816668959,0.9502196193265008 +46,0.17709277664536216,0.12949952900235925,0.9284040770256866,0.9518950437317785,0.9808630989798061,0.989336925940722,0.9280750431652822,0.9518950437317785 +47,0.1776126382921709,0.13869572819669462,0.9277285631220713,0.9453352769679301,0.9807427155697823,0.9896365459969911,0.9273496192129829,0.9463902787705504 +48,0.17726845076405065,0.1274495993254831,0.9266853644354756,0.9518950437317785,0.9808809555968733,0.9895111730656443,0.9263110851367379,0.9516837481698389 +49,0.17738705108885555,0.1285623211858919,0.9273694291479974,0.9489795918367347,0.9808116394122064,0.9895122355481135,0.9270700965071951,0.9489795918367347 +50,0.17664882755782685,0.1259572171435064,0.92741218319253,0.9540816326530612,0.9809636039599241,0.989799105814754,0.9269819970926982,0.9539810080350621 +51,0.17600744828802498,0.12716585508501566,0.9278055204022301,0.9497084548104956,0.9811120241202851,0.9897969808498159,0.9273901564340938,0.9498910675381264 +52,0.17542210658560187,0.12426498649592997,0.9281390019495844,0.9540816326530612,0.9812825283378522,0.990067913879421,0.9276764199655766,0.9539810080350621 +53,0.1766666979093038,0.12476968452464735,0.9278568252556691,0.9533527696793003,0.9810123785495447,0.9900339144404118,0.9274554818961144,0.9532846715328467 +54,0.17660799297673369,0.126970670748035,0.9284981359236584,0.9504373177842566,0.9809859233054894,0.9900456017475712,0.9280849014413981,0.9506531204644412 +55,0.17558396369189266,0.12640303398316874,0.9275318945172213,0.9504373177842566,0.9812259422916837,0.9899691030098002,0.9271362616388538,0.9505813953488372 +56,0.17395585639141128,0.1250900527565542,0.9286263980572562,0.9526239067055393,0.9815714387535673,0.9900572890547306,0.9282897619395356,0.9526584122359796 +57,0.17536393163912592,0.12370957225648029,0.9280962479050519,0.9533527696793003,0.9812844947285105,0.9901571624068203,0.9277074252701623,0.9532846715328467 +58,0.17566584592891074,0.12333806076306991,0.9286092964394431,0.9526239067055393,0.9811826397284211,0.9901699121964488,0.9281899109792285,0.9524506217995611 +59,0.17558764315387043,0.1256001479163462,0.9283527721722475,0.9526239067055393,0.9812124197183688,0.98995847818511,0.9279839104762396,0.9525893508388038 +60,0.17575680659326715,0.12565061119765195,0.9283100181277149,0.9518950437317785,0.9811708919809725,0.9900307269930045,0.9279762211569851,0.9518950437317785 +61,0.17540902452454887,0.12461533680905754,0.9288059650442931,0.9518950437317785,0.9812550357192646,0.9901051007658375,0.9284179032618601,0.9518950437317785 +62,0.17541102996259683,0.12432444899318518,0.9282245100386497,0.9533527696793003,0.9812681197408146,0.990126350415218,0.9278270738753611,0.9532846715328467 +63,0.1749994034859829,0.12393498219245551,0.9283100181277149,0.9533527696793003,0.9813248757093408,0.990092350976209,0.9279527017736835,0.9532846715328467 +64,0.17485610548442898,0.12386349512606251,0.9280620446694258,0.9533527696793003,0.9813954807887251,0.9902049741179271,0.9277215048497813,0.9532846715328467 +65,0.1759885422194563,0.12439083941172233,0.92741218319253,0.9533527696793003,0.9811308063901275,0.9901656622665727,0.9270810964034463,0.9532846715328467 +66,0.1759207148018135,0.12433676582383693,0.9277542155487909,0.9533527696793003,0.9811570319026647,0.9901645997841035,0.9273473037930056,0.9532846715328467 +67,0.17424281581552825,0.12447478372397297,0.9291736498272737,0.9533527696793003,0.9815324444971079,0.9901242254502801,0.9287453223794572,0.9532846715328467 +68,0.17385396183986573,0.12418095758809293,0.9288914731333584,0.9533527696793003,0.9815897931466292,0.9901380377223776,0.9286033174216147,0.9532846715328467 +69,0.1750469607995702,0.12394943818145869,0.9287119061463215,0.9533527696793003,0.9813509181385803,0.9901422876522538,0.9283941286105696,0.9532846715328467 +70,0.17642186737588156,0.12356808784882112,0.9287888634264801,0.9533527696793003,0.9810236544041807,0.9901922243282987,0.9284695858313435,0.9532846715328467 +71,0.17437013022288922,0.12374842514449584,0.9286007456305366,0.9533527696793003,0.9815056148974278,0.9901752246087939,0.928130002926443,0.9532846715328467 +72,0.1753760602373747,0.12390452723287633,0.9293446660054041,0.9533527696793003,0.9812637434358219,0.9901667247490417,0.9289026940053863,0.9532846715328467 +73,0.17607059463969202,0.12404029848971798,0.9281732051852105,0.9533527696793003,0.9811083219478821,0.9901656622665727,0.9277854195323246,0.9532846715328467 +74,0.17546011868152164,0.12413608482645135,0.9286434996750692,0.9533527696793003,0.9812536699061651,0.9901624748191655,0.9282440647652132,0.9532846715328467 +75,0.17476058825221047,0.12416948035424548,0.9283356705544344,0.9533527696793003,0.9814359636937233,0.9901592873717584,0.9279109574312526,0.9532846715328467 +76,0.1753198992475364,0.12414770433271939,0.9284639326880323,0.9533527696793003,0.9812443771127117,0.9901614123366964,0.9280950252690205,0.9532846715328467 +77,0.1746743339889128,0.12415588093221014,0.9289085747511715,0.9533527696793003,0.9814541446548435,0.9901603498542274,0.9285087794727157,0.9532846715328467 +78,0.17683591671265333,0.12414996087029793,0.9266084071553169,0.9533527696793003,0.9809634792234599,0.9901635373016345,0.9262951799469304,0.9532846715328467 diff --git a/training_notebook_c2.ipynb b/training_notebook_c2.ipynb new file mode 100644 index 0000000000000000000000000000000000000000..0f8f032a2e59d06139815e5d9ae0c047d9139fdd --- /dev/null +++ b/training_notebook_c2.ipynb @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3840ec461cf0a549c6e39196be842adfbe3b10df2d6dbc623fd1d1a0a8689940 +size 25453968