diff --git a/.gitattributes b/.gitattributes index a6344aac8c09253b3b630fb776ae94478aa0275b..4fac31e3a3b81149380750895047504e33b3a4ad 100644 --- a/.gitattributes +++ b/.gitattributes @@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text *.zip filter=lfs diff=lfs merge=lfs -text *.zst filter=lfs diff=lfs merge=lfs -text *tfevents* filter=lfs diff=lfs merge=lfs -text +training_curves/DeiT3_combined_metrics.png filter=lfs diff=lfs merge=lfs -text +training_curves/DeiT_combined_metrics.png filter=lfs diff=lfs merge=lfs -text +training_notebook_c2.ipynb filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..9d3e14d70861c29d7272a740bdc5bc1f0ea87b92 --- /dev/null +++ b/README.md @@ -0,0 +1,166 @@ +--- +license: apache-2.0 +tags: +- image-classification +- pytorch +- timm +- deit +- vision-transformer +- transformer +- gravitational-lensing +- strong-lensing +- astronomy +- astrophysics +datasets: +- parlange/gravit-c21-j24 +metrics: +- accuracy +- auc +- f1 +paper: +- title: "GraViT: A Gravitational Lens Discovery Toolkit with Vision Transformers" + url: "https://arxiv.org/abs/2509.00226" + authors: "Parlange et al." +model-index: +- name: DeiT-c2 + results: + - task: + type: image-classification + name: Strong Gravitational Lens Discovery + dataset: + type: common-test-sample + name: Common Test Sample (More et al. 2024) + metrics: + - type: accuracy + value: 0.8757 + name: Average Accuracy + - type: auc + value: 0.9165 + name: Average AUC-ROC + - type: f1 + value: 0.6956 + name: Average F1-Score +--- + +# 🌌 deit-gravit-c2 + +πŸ”­ This model is part of **GraViT**: Transfer Learning with Vision Transformers and MLP-Mixer for Strong Gravitational Lens Discovery + +πŸ”— **GitHub Repository**: [https://github.com/parlange/gravit](https://github.com/parlange/gravit) + +## πŸ›°οΈ Model Details + +- **πŸ€– Model Type**: DeiT +- **πŸ§ͺ Experiment**: C2 - C21+J24-half +- **🌌 Dataset**: C21+J24 +- **πŸͺ Fine-tuning Strategy**: half + + + +## πŸ’» Quick Start + +```python +import torch +import timm + +# Load the model directly from the Hub +model = timm.create_model( + 'hf-hub:parlange/deit-gravit-c2', + pretrained=True +) +model.eval() + +# Example inference +dummy_input = torch.randn(1, 3, 224, 224) +with torch.no_grad(): + output = model(dummy_input) + predictions = torch.softmax(output, dim=1) +print(f"Lens probability: {predictions[0][1]:.4f}") +``` + +## ⚑️ Training Configuration + +**Training Dataset:** C21+J24 (CaΓ±ameras et al. 2021 + Jaelani et al. 2024) +**Fine-tuning Strategy:** half + + +| πŸ”§ Parameter | πŸ“ Value | +|--------------|----------| +| Batch Size | 192 | +| Learning Rate | AdamW with ReduceLROnPlateau | +| Epochs | 100 | +| Patience | 10 | +| Optimizer | AdamW | +| Scheduler | ReduceLROnPlateau | +| Image Size | 224x224 | +| Fine Tune Mode | half | +| Stochastic Depth Probability | 0.1 | + + +## πŸ“ˆ Training Curves + +![Combined Training Metrics](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/training_curves/DeiT_combined_metrics.png) + + +## 🏁 Final Epoch Training Metrics + +| Metric | Training | Validation | +|:---------:|:-----------:|:-------------:| +| πŸ“‰ Loss | 0.0147 | 0.0489 | +| 🎯 Accuracy | 0.9947 | 0.9920 | +| πŸ“Š AUC-ROC | 0.9998 | 0.9985 | +| βš–οΈ F1 Score | 0.9947 | 0.9920 | + + +## β˜‘οΈ Evaluation Results + +### ROC Curves and Confusion Matrices + +Performance across all test datasets (a through l) in the Common Test Sample (More et al. 2024): + +![ROC + Confusion Matrix - Dataset A](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_a.png) +![ROC + Confusion Matrix - Dataset B](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_b.png) +![ROC + Confusion Matrix - Dataset C](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_c.png) +![ROC + Confusion Matrix - Dataset D](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_d.png) +![ROC + Confusion Matrix - Dataset E](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_e.png) +![ROC + Confusion Matrix - Dataset F](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_f.png) +![ROC + Confusion Matrix - Dataset G](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_g.png) +![ROC + Confusion Matrix - Dataset H](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_h.png) +![ROC + Confusion Matrix - Dataset I](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_i.png) +![ROC + Confusion Matrix - Dataset J](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_j.png) +![ROC + Confusion Matrix - Dataset K](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_k.png) +![ROC + Confusion Matrix - Dataset L](https://huggingface.co/parlange/deit-gravit-c2/resolve/main/roc_confusion_matrix/DeiT_roc_confusion_matrix_l.png) + +### πŸ“‹ Performance Summary + +Average performance across 12 test datasets from the Common Test Sample (More et al. 2024): + +| Metric | Value | +|-----------|----------| +| 🎯 Average Accuracy | 0.8757 | +| πŸ“ˆ Average AUC-ROC | 0.9165 | +| βš–οΈ Average F1-Score | 0.6956 | + + +## πŸ“˜ Citation + +If you use this model in your research, please cite: + +```bibtex +@misc{parlange2025gravit, + title={GraViT: Transfer Learning with Vision Transformers and MLP-Mixer for Strong Gravitational Lens Discovery}, + author={RenΓ© Parlange and Juan C. Cuevas-Tello and Octavio Valenzuela and Omar de J. Cabrera-Rosas and TomΓ‘s Verdugo and Anupreeta More and Anton T. Jaelani}, + year={2025}, + eprint={2509.00226}, + archivePrefix={arXiv}, + primaryClass={cs.CV}, + url={https://arxiv.org/abs/2509.00226}, +} +``` + +--- + + +## Model Card Contact + +For questions about this model, please contact the author through: https://github.com/parlange/ diff --git a/config.json b/config.json new file mode 100644 index 0000000000000000000000000000000000000000..11dc512ab066e042bc56422ce74485e885eaff89 --- /dev/null +++ b/config.json @@ -0,0 +1,76 @@ +{ + "architecture": "vit_base_patch16_224", + "num_classes": 2, + "num_features": 1000, + "global_pool": "avg", + "crop_pct": 0.875, + "interpolation": "bicubic", + "mean": [ + 0.485, + 0.456, + 0.406 + ], + "std": [ + 0.229, + 0.224, + 0.225 + ], + "first_conv": "conv1", + "classifier": "fc", + "input_size": [ + 3, + 224, + 224 + ], + "pool_size": [ + 7, + 7 + ], + "pretrained_cfg": { + "tag": "gravit_c2", + "custom_load": false, + "input_size": [ + 3, + 224, + 224 + ], + "fixed_input_size": true, + "interpolation": "bicubic", + "crop_pct": 0.875, + "crop_mode": "center", + "mean": [ + 0.485, + 0.456, + 0.406 + ], + "std": [ + 0.229, + 0.224, + 0.225 + ], + "num_classes": 2, + "pool_size": [ + 7, + 7 + ], + "first_conv": "conv1", + "classifier": "fc" + }, + "model_name": "deit_gravit_c2", + "experiment": "c2", + "training_strategy": "half", + "dataset": "C21+J24", + "hyperparameters": { + "batch_size": "192", + "learning_rate": "AdamW with ReduceLROnPlateau", + "epochs": "100", + "patience": "10", + "optimizer": "AdamW", + "scheduler": "ReduceLROnPlateau", + "image_size": "224x224", + "fine_tune_mode": "half", + "stochastic_depth_probability": "0.1" + }, + "hf_hub_id": "parlange/deit-gravit-c2", + "license": "apache-2.0" +} \ No newline at end of file diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_a.png b/confusion_matrices/DeiT3_Confusion_Matrix_a.png new file mode 100644 index 0000000000000000000000000000000000000000..1782e6533a91bb580c86593ba7ac621fe71e0f1c Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_a.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_b.png b/confusion_matrices/DeiT3_Confusion_Matrix_b.png new file mode 100644 index 0000000000000000000000000000000000000000..400bbee115f0299778f7b39b628c05fad1e20e71 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_b.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_c.png b/confusion_matrices/DeiT3_Confusion_Matrix_c.png new file mode 100644 index 0000000000000000000000000000000000000000..4f64205dad7058fc29a9fa919e958d725bec2b58 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_c.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_d.png b/confusion_matrices/DeiT3_Confusion_Matrix_d.png new file mode 100644 index 0000000000000000000000000000000000000000..b03b3e6a8d1251d4aa4f19a55e69766195f209b9 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_d.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_e.png b/confusion_matrices/DeiT3_Confusion_Matrix_e.png new file mode 100644 index 0000000000000000000000000000000000000000..0d55e2bba1188de1930a9010180aad8d411e9ca6 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_e.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_f.png b/confusion_matrices/DeiT3_Confusion_Matrix_f.png new file mode 100644 index 0000000000000000000000000000000000000000..a311b397b6b959717fef3990b9dd25e00910db65 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_f.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_g.png b/confusion_matrices/DeiT3_Confusion_Matrix_g.png new file mode 100644 index 0000000000000000000000000000000000000000..9dad35d4d4725043c00a39b2ccadc8442aa759cf Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_g.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_h.png b/confusion_matrices/DeiT3_Confusion_Matrix_h.png new file mode 100644 index 0000000000000000000000000000000000000000..7277a2051488d47690892e74b788b9f965d08255 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_h.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_i.png b/confusion_matrices/DeiT3_Confusion_Matrix_i.png new file mode 100644 index 0000000000000000000000000000000000000000..b4700ed342c4e2de22b0b66d5e40e1fcb6ecabc2 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_i.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_j.png b/confusion_matrices/DeiT3_Confusion_Matrix_j.png new file mode 100644 index 0000000000000000000000000000000000000000..4ce44662af82bbf5500dd7ec1d5becad0914a0d6 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_j.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_k.png b/confusion_matrices/DeiT3_Confusion_Matrix_k.png new file mode 100644 index 0000000000000000000000000000000000000000..daa6d7c719d5ec6de46c686de356a76b729494c2 Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_k.png differ diff --git a/confusion_matrices/DeiT3_Confusion_Matrix_l.png b/confusion_matrices/DeiT3_Confusion_Matrix_l.png new file mode 100644 index 0000000000000000000000000000000000000000..2e8cdf214033f8cb895ca4eeeacf1b51368d240b Binary files /dev/null and b/confusion_matrices/DeiT3_Confusion_Matrix_l.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_a.png b/confusion_matrices/DeiT_Confusion_Matrix_a.png new file mode 100644 index 0000000000000000000000000000000000000000..e69b8bf3b384026f8ce140834e66ee7b4df24cbb Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_a.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_b.png b/confusion_matrices/DeiT_Confusion_Matrix_b.png new file mode 100644 index 0000000000000000000000000000000000000000..ed0702e9b1730e8b5df8a775bdf5e875ec3b6df3 Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_b.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_c.png b/confusion_matrices/DeiT_Confusion_Matrix_c.png new file mode 100644 index 0000000000000000000000000000000000000000..89ed7ec876e89695d745efe3bb3ec242d5304980 Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_c.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_d.png b/confusion_matrices/DeiT_Confusion_Matrix_d.png new file mode 100644 index 0000000000000000000000000000000000000000..c7c65342fbbdad423d14a0791c9605209176b9f2 Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_d.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_e.png b/confusion_matrices/DeiT_Confusion_Matrix_e.png new file mode 100644 index 0000000000000000000000000000000000000000..3153c4f6740dc0130bb4af4986eda20d2c78d443 Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_e.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_f.png b/confusion_matrices/DeiT_Confusion_Matrix_f.png new file mode 100644 index 0000000000000000000000000000000000000000..eac9c142d770edc6754ed78a54643556f25a253e Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_f.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_g.png b/confusion_matrices/DeiT_Confusion_Matrix_g.png new file mode 100644 index 0000000000000000000000000000000000000000..5c03bb3bc31b8b3f29b3c8e4b84111d21fc07ea1 Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_g.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_h.png b/confusion_matrices/DeiT_Confusion_Matrix_h.png new file mode 100644 index 0000000000000000000000000000000000000000..e6bc38285100f423d2bd7ddf9777262dc24d907a Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_h.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_i.png b/confusion_matrices/DeiT_Confusion_Matrix_i.png new file mode 100644 index 0000000000000000000000000000000000000000..9a88b3fc9fb62878a69252aba811a2e1fa4114db Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_i.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_j.png b/confusion_matrices/DeiT_Confusion_Matrix_j.png new file mode 100644 index 0000000000000000000000000000000000000000..055ae0ca993852e60e67215b312808f03af5f968 Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_j.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_k.png b/confusion_matrices/DeiT_Confusion_Matrix_k.png new file mode 100644 index 0000000000000000000000000000000000000000..0728ed2f1bed0688b0a0b47c50aaa36fd049ad9c Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_k.png differ diff --git a/confusion_matrices/DeiT_Confusion_Matrix_l.png b/confusion_matrices/DeiT_Confusion_Matrix_l.png new file mode 100644 index 0000000000000000000000000000000000000000..837c7eb87cb9ed6e0827c0d1fbfa837d73bfa0ac Binary files /dev/null and b/confusion_matrices/DeiT_Confusion_Matrix_l.png differ diff --git a/deit-gravit-c2.pth b/deit-gravit-c2.pth new file mode 100644 index 0000000000000000000000000000000000000000..561791160d9210bf94922d7edb5a566c0451d108 --- /dev/null +++ b/deit-gravit-c2.pth @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d3ec1b2a971c379028f37c090a3eb26c57970a94860301a894a46e0b96f357ba +size 343259194 diff --git a/evaluation_results.csv b/evaluation_results.csv new file mode 100644 index 0000000000000000000000000000000000000000..51ad31002d20e48ac3ebf8b61b5b308068673ca5 --- /dev/null +++ b/evaluation_results.csv @@ -0,0 +1,133 @@ +Model,Dataset,Loss,Accuracy,AUCROC,F1 +ViT,a,0.35447569389258865,0.8949115044247787,0.9020846228498507,0.7480106100795756 +ViT,b,0.2228443425890036,0.9264382269726501,0.9263609576427256,0.5465116279069767 +ViT,c,0.46229862214933587,0.8349575605155611,0.8684438305709024,0.34944237918215615 +ViT,d,0.11673173789463115,0.9537881169443572,0.9704917127071824,0.6573426573426573 +ViT,e,0.3652098159562351,0.8825466520307355,0.920767426019829,0.7249357326478149 +ViT,f,0.24608832064126923,0.9108519842016175,0.9203345361214339,0.22926829268292684 +ViT,g,0.10483654439449311,0.9635,0.997473,0.9644999189495866 +ViT,h,0.23178722894191742,0.915,0.9939590555555555,0.9210526315789473 +ViT,i,0.04857917896906535,0.978,0.9990572222222223,0.9782966129562644 +ViT,j,2.494326035181681,0.6106666666666667,0.5831323333333334,0.42349457058242845 +ViT,k,2.4380686638752618,0.6251666666666666,0.7805802777777779,0.43278688524590164 +ViT,l,1.0272723743838732,0.8127329565949261,0.7993805230717175,0.7184308053873272 +MLP-Mixer,a,1.230455079964832,0.6227876106194691,0.8958911227772556,0.49028400597907323 +MLP-Mixer,b,1.0728926989350893,0.7004086765168186,0.9182900552486188,0.25604996096799376 +MLP-Mixer,c,1.374837134027586,0.5576862621817039,0.8979152854511969,0.18904899135446687 +MLP-Mixer,d,0.09552026474693218,0.9603898145237346,0.9868913443830571,0.7224669603524229 +MLP-Mixer,e,0.9593323631422711,0.7069154774972558,0.9188677817301143,0.5512605042016807 +MLP-Mixer,f,0.9257462782946794,0.7154410381794245,0.9306221006103087,0.09779367918902802 +MLP-Mixer,g,0.5643243643840155,0.8425,0.991425611111111,0.8635773061931572 +MLP-Mixer,h,0.7244052359660467,0.7668333333333334,0.9891666111111111,0.8104592873594364 +MLP-Mixer,i,0.04615406060218811,0.9803333333333333,0.9994367777777778,0.980655737704918 +MLP-Mixer,j,3.0292422666549683,0.45216666666666666,0.392282,0.28309705561613957 +MLP-Mixer,k,2.5110719747940697,0.59,0.7661271111111111,0.3453964874933475 +MLP-Mixer,l,1.4846716919555334,0.6762053625105207,0.7295511702036557,0.5855010004617516 +CvT,a,0.7465745627352621,0.6493362831858407,0.7317079694031161,0.4389380530973451 +CvT,b,0.7336456650122649,0.6765168186104998,0.7552670349907918,0.1942051683633516 +CvT,c,0.8642418710588097,0.5919522162841874,0.6964806629834255,0.16041397153945666 +CvT,d,0.06205783033066015,0.9761081420936812,0.9876427255985267,0.7654320987654321 +CvT,e,0.6019917449757506,0.7178924259055982,0.7936123514720351,0.4910891089108911 +CvT,f,0.5685286294680824,0.7414895617829603,0.8061353821076506,0.08274941608274941 +CvT,g,0.4509977758725484,0.8055,0.9201512777777776,0.8277999114652501 +CvT,h,0.5202355206807454,0.7606666666666667,0.9072719444444444,0.7961964235026966 +CvT,i,0.09494428576032321,0.9643333333333334,0.9977035555555557,0.9632554945054945 +CvT,j,2.988422914981842,0.3456666666666667,0.14668444444444442,0.022896963663514187 +CvT,k,2.6323694267769655,0.5045,0.6181494444444444,0.0300163132137031 +CvT,l,1.337245315202257,0.645425033064807,0.6032419706344807,0.5021944632005402 +Swin,a,0.47572549887463056,0.8407079646017699,0.905882487792577,0.6742081447963801 +Swin,b,0.24361524523634911,0.9163784973278843,0.9362615101289135,0.5283687943262412 +Swin,c,0.4370936370240709,0.8535051870480981,0.9087605893186003,0.3900523560209424 +Swin,d,0.038348094671021904,0.9880540710468406,0.9911620626151013,0.8869047619047619 +Swin,e,0.3579506372581067,0.8781558726673985,0.9260273972602739,0.7286063569682152 +Swin,f,0.24650774364781286,0.9156479217603912,0.9413092437445593,0.24937238493723848 +Swin,g,0.11494702147444089,0.9593333333333334,0.9989898888888888,0.9607969151670951 +Swin,h,0.2175228010714054,0.926,0.9979807777777777,0.9308841843088418 +Swin,i,0.006121216081082821,0.9973333333333333,0.9999798888888889,0.9973315543695798 +Swin,j,2.5422419211069744,0.5825,0.4893003333333333,0.3679031037093111 +Swin,k,2.433416116627554,0.6205,0.7913794999999999,0.39036144578313253 +Swin,l,1.035569912688268,0.8089455332451605,0.7797953948083542,0.7088143668682426 +CaiT,a,0.3509529214517205,0.9081858407079646,0.8966973093999068,0.7726027397260274 +CaiT,b,0.1907231829655279,0.9380697893744105,0.9234548802946593,0.5887265135699373 +CaiT,c,0.3048490960337163,0.90883370009431,0.8791160220994475,0.493006993006993 +CaiT,d,0.06549901952829443,0.9849104055328513,0.969243093922652,0.8545454545454545 +CaiT,e,0.31167979835318943,0.9187705817782656,0.9264058124574283,0.7921348314606742 +CaiT,f,0.1541684599891403,0.9499717886025955,0.9222261921687871,0.3464373464373464 +CaiT,g,0.07805611325552066,0.9708333333333333,0.9986172777777778,0.9714937286202965 +CaiT,h,0.13856186520308256,0.9553333333333334,0.997130611111111,0.9569961489088575 +CaiT,i,0.011666435472667217,0.9956666666666667,0.9999013333333333,0.9956594323873121 +CaiT,j,1.8389671653707822,0.6116666666666667,0.7423962222222222,0.4151606425702811 +CaiT,k,1.7725774958133698,0.6365,0.8888650555555555,0.4312907431551499 +CaiT,l,0.7395369254032035,0.8362991463268006,0.8693810723675515,0.7436693965922997 +DeiT,a,0.48058320357736234,0.8263274336283186,0.8941450218931248,0.6594360086767896 +DeiT,b,0.23002449519573911,0.9251807607670544,0.9313581952117864,0.5608856088560885 +DeiT,c,0.49494195908204974,0.8154668343288274,0.8907605893186004,0.34118967452300786 +DeiT,d,0.05036040664735698,0.9849104055328513,0.9769023941068141,0.8636363636363636 +DeiT,e,0.338863200106291,0.8792535675082327,0.9161961704382048,0.7342995169082126 +DeiT,f,0.26403015722496653,0.9037050968591311,0.9291450866890099,0.2289156626506024 +DeiT,g,0.10851164469867945,0.9641666666666666,0.9990410000000001,0.9653393519264872 +DeiT,h,0.2489620513096452,0.906,0.9981344444444444,0.9139194139194139 +DeiT,i,0.013259729760388533,0.9958333333333333,0.9998315555555556,0.9958423415932147 +DeiT,j,1.2026229511300723,0.7143333333333334,0.7246498888888889,0.6356292517006803 +DeiT,k,1.1073710439900557,0.746,0.8698901111111111,0.6623836951705804 +DeiT,l,0.5658274294531473,0.8476012985451485,0.867833726587774,0.7854785478547854 +DeiT3,a,0.39277621998196155,0.8661504424778761,0.9195532732705195,0.7125890736342043 +DeiT3,b,0.338128161960636,0.8824269097767997,0.9331012891344382,0.44510385756676557 +DeiT3,c,0.323060417608134,0.8883998742533794,0.922292817679558,0.4580152671755725 +DeiT3,d,0.12409640010358478,0.9553599497013517,0.9608121546961326,0.6787330316742082 +DeiT3,e,0.24973662732461413,0.9209659714599341,0.9483084840687203,0.8064516129032258 +DeiT3,f,0.2540075041596123,0.9116042881324055,0.9380772021883802,0.24193548387096775 +DeiT3,g,0.1656125110021482,0.9416666666666667,0.9990236666666666,0.944760101010101 +DeiT3,h,0.15762409150910875,0.9448333333333333,0.9990646111111111,0.9476017096723128 +DeiT3,i,0.05214000094247361,0.9803333333333333,0.9997376666666667,0.9806684141546527 +DeiT3,j,1.1591287109454473,0.696,0.7744774999999999,0.6248457424928013 +DeiT3,k,1.0456561943689981,0.7346666666666667,0.845634,0.6561555075593952 +DeiT3,l,0.5223108836063022,0.854033906456655,0.8898184372191467,0.7933968686181075 +Twins_SVT,a,0.4211153812640536,0.8307522123893806,0.8825833123189902,0.6433566433566433 +Twins_SVT,b,0.3625493723054758,0.8550770198050928,0.8962191528545118,0.37449118046132973 +Twins_SVT,c,0.47319920195681764,0.7868594781515247,0.8548139963167587,0.2893081761006289 +Twins_SVT,d,0.1203458983801289,0.9783087079534738,0.9818324125230202,0.8 +Twins_SVT,e,0.5213294555274637,0.7486278814489572,0.8316203738742148,0.5465346534653466 +Twins_SVT,f,0.3335461875583885,0.8666541282678202,0.9034523383543173,0.16292798110979928 +Twins_SVT,g,0.2639119902451833,0.9085,0.9744078888888889,0.912676952441546 +Twins_SVT,h,0.32257486327489215,0.8723333333333333,0.9662636666666669,0.8822263222632226 +Twins_SVT,i,0.13550377811988196,0.9738333333333333,0.9972788888888889,0.9733672603901612 +Twins_SVT,j,1.2430085968176523,0.49,0.43771377777777776,0.1896186440677966 +Twins_SVT,k,1.1146003757913907,0.5553333333333333,0.7234002222222222,0.2115839243498818 +Twins_SVT,l,0.6286477774643219,0.7480461704941685,0.7275090480198628,0.6162439337057046 +Twins_PCPVT,a,0.45601994748664115,0.7699115044247787,0.8394007473464615,0.5458515283842795 +Twins_PCPVT,b,0.3125818614145001,0.8773970449544168,0.9010699815837937,0.390625 +Twins_PCPVT,c,0.5049686531944119,0.7500785916378497,0.8135911602209945,0.23923444976076555 +Twins_PCPVT,d,0.3149096430453517,0.8918579063187677,0.9015690607734806,0.4208754208754209 +Twins_PCPVT,e,0.42039827045572575,0.8079034028540066,0.8655339438431847,0.5882352941176471 +Twins_PCPVT,f,0.3770137148085496,0.8412638706037239,0.8693597175042401,0.12899896800825594 +Twins_PCPVT,g,0.2785677030881246,0.9015,0.9626754444444443,0.9027480664801711 +Twins_PCPVT,h,0.3805647597312927,0.834,0.928301,0.8463437210737427 +Twins_PCPVT,i,0.2798018006483714,0.9091666666666667,0.9656723333333334,0.9096335599403084 +Twins_PCPVT,j,0.614702238559723,0.6835,0.7995154444444446,0.6018033130635353 +Twins_PCPVT,k,0.6159363424777985,0.6911666666666667,0.7903985,0.6076646199449502 +Twins_PCPVT,l,0.45535326129802217,0.7889864133702056,0.8498913163479216,0.7103004291845494 +PiT,a,0.3937257931823224,0.8296460176991151,0.8874127904755356,0.641860465116279 +PiT,b,0.2796248870145521,0.8777114115058158,0.91848802946593,0.4150375939849624 +PiT,c,0.5313189482209218,0.7613957874882112,0.8498581952117863,0.26666666666666666 +PiT,d,0.049343678185640734,0.9798805407104684,0.9911620626151012,0.8117647058823529 +PiT,e,0.3259278782832505,0.8518111964873765,0.9145841216983274,0.6715328467153284 +PiT,f,0.2841162405192056,0.8750235094978371,0.9172267022129574,0.17196261682242991 +PiT,g,0.1590204114516576,0.9338333333333333,0.9916004444444445,0.9369340746624305 +PiT,h,0.2924602138201396,0.8721666666666666,0.981646111111111,0.8849212303075769 +PiT,i,0.03693298858900865,0.988,0.999485,0.9879396984924623 +PiT,j,2.9977854507366817,0.461,0.277717,0.06477732793522267 +PiT,k,2.8756980224698783,0.5151666666666667,0.7229978888888889,0.07149696776252792 +PiT,l,1.2244331041709067,0.7434170975111218,0.6790239785353327,0.599849990624414 +Ensemble,a,,0.9070796460176991,0.941851401847734,0.79 +Ensemble,b,,0.9374410562716127,0.9600349907918969,0.6135922330097088 +Ensemble,c,,0.895001571832757,0.9307624309392265,0.48615384615384616 +Ensemble,d,,0.9911977365608299,0.9944677716390424,0.9186046511627907 +Ensemble,e,,0.9264544456641054,0.955384848255506,0.825065274151436 +Ensemble,f,,0.941696445363927,0.9599335198386041,0.33760683760683763 +Ensemble,g,,0.9701666666666666,0.9990522222222222,0.9710027539283979 +Ensemble,h,,0.9476666666666667,0.9979163333333333,0.9502219403931516 +Ensemble,i,,0.9986666666666667,0.9999886666666667,0.9986671109630123 +Ensemble,j,,0.5698333333333333,0.6426453333333333,0.31556616282153277 +Ensemble,k,,0.5983333333333334,0.8897323333333333,0.33055555555555555 +Ensemble,l,,0.8179632078874595,0.832089495815299,0.712386018237082 diff --git a/model.safetensors b/model.safetensors new file mode 100644 index 0000000000000000000000000000000000000000..ee89c91bccf9703019318c9f440ce45363235ad0 --- /dev/null +++ b/model.safetensors @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:816c2da2987688f7f67abbed02eb53ac6e326aca96bfa42efd888c3cb9307ebf +size 343214864 diff --git a/pytorch_model.bin b/pytorch_model.bin new file mode 100644 index 0000000000000000000000000000000000000000..561791160d9210bf94922d7edb5a566c0451d108 --- /dev/null +++ b/pytorch_model.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d3ec1b2a971c379028f37c090a3eb26c57970a94860301a894a46e0b96f357ba +size 343259194 diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_a.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_a.png new file mode 100644 index 0000000000000000000000000000000000000000..da0810c0df886ef0f5096551cdc9319ae06ecf9b Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_a.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_b.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_b.png new file mode 100644 index 0000000000000000000000000000000000000000..04b24373945f08e1cb41f96fb86dd39e7d8f6921 Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_b.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_c.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_c.png new file mode 100644 index 0000000000000000000000000000000000000000..1e6cbb175935634cfb37f5a7f94a8bc80bb181ad Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_c.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_d.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_d.png new file mode 100644 index 0000000000000000000000000000000000000000..46918cd315cf5d37742e2459710905912e5b6418 Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_d.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_e.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_e.png new file mode 100644 index 0000000000000000000000000000000000000000..80bfc4509ae16ee3a068f48a2f438eb10bed7aab Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_e.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_f.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_f.png new file mode 100644 index 0000000000000000000000000000000000000000..891a4e96cf9a7210c69b30c0acfb645ec5c4c617 Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_f.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_g.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_g.png new file mode 100644 index 0000000000000000000000000000000000000000..c46fd6f9e21f655decf2225559946affecdb0078 Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_g.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_h.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_h.png new file mode 100644 index 0000000000000000000000000000000000000000..b7c0ace50e97dcb9532019bd776c9b37fdcc9805 Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_h.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_i.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_i.png new file mode 100644 index 0000000000000000000000000000000000000000..97a58782ed28c69f54dbb985c1e333553ae73d94 Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_i.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_j.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_j.png new file mode 100644 index 0000000000000000000000000000000000000000..48a69cb432e38568625f480b0481e1834d1dc33b Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_j.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_k.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_k.png new file mode 100644 index 0000000000000000000000000000000000000000..63ca93a4a275d5a3a880a3fd49d726cb184d7acc Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_k.png differ diff --git a/roc_confusion_matrix/DeiT3_roc_confusion_matrix_l.png b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_l.png new file mode 100644 index 0000000000000000000000000000000000000000..894800c6c6f5fec91d185671608f5beb2e9dedf3 Binary files /dev/null and b/roc_confusion_matrix/DeiT3_roc_confusion_matrix_l.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_a.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_a.png new file mode 100644 index 0000000000000000000000000000000000000000..46251c66ef6d1a77be4dc9d9c1dff6a5fa088aa4 Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_a.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_b.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_b.png new file mode 100644 index 0000000000000000000000000000000000000000..b261c78bec16d7d494395a175ab5454e91307786 Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_b.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_c.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_c.png new file mode 100644 index 0000000000000000000000000000000000000000..049a7f7feddc16d8bd6f64f269cc4a9ffb3d6e3b Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_c.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_d.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_d.png new file mode 100644 index 0000000000000000000000000000000000000000..405279f55178963c7a5afe2099650be8052dad61 Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_d.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_e.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_e.png new file mode 100644 index 0000000000000000000000000000000000000000..e260da85d5d01176accb5129028fc5c731d5a2ae Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_e.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_f.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_f.png new file mode 100644 index 0000000000000000000000000000000000000000..c2e4ea66b5754daf9124660859f9fb88734c46b9 Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_f.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_g.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_g.png new file mode 100644 index 0000000000000000000000000000000000000000..6be7a35211add4d9c0ad73ecd7e7062fb9522052 Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_g.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_h.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_h.png new file mode 100644 index 0000000000000000000000000000000000000000..b83fad98f995f6a8abcdedf98b630620ccd33815 Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_h.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_i.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_i.png new file mode 100644 index 0000000000000000000000000000000000000000..b014e7faabfed4c0cbf1904a774b2d8cf258d07e Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_i.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_j.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_j.png new file mode 100644 index 0000000000000000000000000000000000000000..35e0cdc61f86f69399bd0aab0111cb028d4aa127 Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_j.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_k.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_k.png new file mode 100644 index 0000000000000000000000000000000000000000..1784489407afc0f25257d8a0cf3fd0f89be807d9 Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_k.png differ diff --git a/roc_confusion_matrix/DeiT_roc_confusion_matrix_l.png b/roc_confusion_matrix/DeiT_roc_confusion_matrix_l.png new file mode 100644 index 0000000000000000000000000000000000000000..1bd6cc113ec50c62470afe53a8dc7c628febc20a Binary files /dev/null and b/roc_confusion_matrix/DeiT_roc_confusion_matrix_l.png differ diff --git a/roc_curves/DeiT3_ROC_a.png b/roc_curves/DeiT3_ROC_a.png new file mode 100644 index 0000000000000000000000000000000000000000..61e8eaef1bfdb82d66e455bee3df1b3872f063d0 Binary files /dev/null and b/roc_curves/DeiT3_ROC_a.png differ diff --git a/roc_curves/DeiT3_ROC_b.png b/roc_curves/DeiT3_ROC_b.png new file mode 100644 index 0000000000000000000000000000000000000000..93dd62aeb4696a86d52088d47c72f879359827a5 Binary files /dev/null and b/roc_curves/DeiT3_ROC_b.png differ diff --git a/roc_curves/DeiT3_ROC_c.png b/roc_curves/DeiT3_ROC_c.png new file mode 100644 index 0000000000000000000000000000000000000000..892a0abab7dc770d511ac8737b0c2a381b342406 Binary files /dev/null and b/roc_curves/DeiT3_ROC_c.png differ diff --git a/roc_curves/DeiT3_ROC_d.png b/roc_curves/DeiT3_ROC_d.png new file mode 100644 index 0000000000000000000000000000000000000000..397ad6f8b2172f7462261ffbab505b0f3b79975b Binary files /dev/null and b/roc_curves/DeiT3_ROC_d.png differ diff --git a/roc_curves/DeiT3_ROC_e.png b/roc_curves/DeiT3_ROC_e.png new file mode 100644 index 0000000000000000000000000000000000000000..88dc63bef952cfb14c1781acf27e8b832dafdb8a Binary files /dev/null and b/roc_curves/DeiT3_ROC_e.png differ diff --git a/roc_curves/DeiT3_ROC_f.png b/roc_curves/DeiT3_ROC_f.png new file mode 100644 index 0000000000000000000000000000000000000000..cdfd4956e1d98133473e26f9934cd5d7be0aca7f Binary files /dev/null and b/roc_curves/DeiT3_ROC_f.png differ diff --git a/roc_curves/DeiT3_ROC_g.png b/roc_curves/DeiT3_ROC_g.png new file mode 100644 index 0000000000000000000000000000000000000000..bee5133c396b8d8d72eee961d8541bee2bd04159 Binary files /dev/null and b/roc_curves/DeiT3_ROC_g.png differ diff --git a/roc_curves/DeiT3_ROC_h.png b/roc_curves/DeiT3_ROC_h.png new file mode 100644 index 0000000000000000000000000000000000000000..b140c134b2d84a7cf42243e7c12b055a21ac4526 Binary files /dev/null and b/roc_curves/DeiT3_ROC_h.png differ diff --git a/roc_curves/DeiT3_ROC_i.png b/roc_curves/DeiT3_ROC_i.png new file mode 100644 index 0000000000000000000000000000000000000000..ba9ef72df6862f1141a0295685972cf186d1568f Binary files /dev/null and b/roc_curves/DeiT3_ROC_i.png differ diff --git a/roc_curves/DeiT3_ROC_j.png b/roc_curves/DeiT3_ROC_j.png new file mode 100644 index 0000000000000000000000000000000000000000..62cf51813b077ab9a6505a7776e5232f05f6fe8b Binary files /dev/null and b/roc_curves/DeiT3_ROC_j.png differ diff --git a/roc_curves/DeiT3_ROC_k.png b/roc_curves/DeiT3_ROC_k.png new file mode 100644 index 0000000000000000000000000000000000000000..b611b6f77a3c34c1ceb6fad8b7d1593ad8c789f0 Binary files /dev/null and b/roc_curves/DeiT3_ROC_k.png differ diff --git a/roc_curves/DeiT3_ROC_l.png b/roc_curves/DeiT3_ROC_l.png new file mode 100644 index 0000000000000000000000000000000000000000..6891c596edfa0b9885c25e8809138bbcfb97c79c Binary files /dev/null and b/roc_curves/DeiT3_ROC_l.png differ diff --git a/roc_curves/DeiT_ROC_a.png b/roc_curves/DeiT_ROC_a.png new file mode 100644 index 0000000000000000000000000000000000000000..b4117bf3dce08eaa66964202b63ec9cf777c28b2 Binary files /dev/null and b/roc_curves/DeiT_ROC_a.png differ diff --git a/roc_curves/DeiT_ROC_b.png b/roc_curves/DeiT_ROC_b.png new file mode 100644 index 0000000000000000000000000000000000000000..72aeaf7931ccf822af705076e74127cf0d252d2e Binary files /dev/null and b/roc_curves/DeiT_ROC_b.png differ diff --git a/roc_curves/DeiT_ROC_c.png b/roc_curves/DeiT_ROC_c.png new file mode 100644 index 0000000000000000000000000000000000000000..e5c945b9c0436095f45eb96ff9131cb6429622d8 Binary files /dev/null and b/roc_curves/DeiT_ROC_c.png differ diff --git a/roc_curves/DeiT_ROC_d.png b/roc_curves/DeiT_ROC_d.png new file mode 100644 index 0000000000000000000000000000000000000000..44a6c3a112e84c0d1a04199507532d6826ca86ce Binary files /dev/null and b/roc_curves/DeiT_ROC_d.png differ diff --git a/roc_curves/DeiT_ROC_e.png b/roc_curves/DeiT_ROC_e.png new file mode 100644 index 0000000000000000000000000000000000000000..d6a7ded8ea225749930dfbc834568e2155a40dc3 Binary files /dev/null and b/roc_curves/DeiT_ROC_e.png differ diff --git a/roc_curves/DeiT_ROC_f.png b/roc_curves/DeiT_ROC_f.png new file mode 100644 index 0000000000000000000000000000000000000000..94618ca431fd6cfb32acc78c254867defa03f329 Binary files /dev/null and b/roc_curves/DeiT_ROC_f.png differ diff --git a/roc_curves/DeiT_ROC_g.png b/roc_curves/DeiT_ROC_g.png new file mode 100644 index 0000000000000000000000000000000000000000..4af9b72100c211b4fcdfbfa7866e44c821b13c41 Binary files /dev/null and b/roc_curves/DeiT_ROC_g.png differ diff --git a/roc_curves/DeiT_ROC_h.png b/roc_curves/DeiT_ROC_h.png new file mode 100644 index 0000000000000000000000000000000000000000..a4fc09a4a014b02ff070de9d992e22bc8d72607b Binary files /dev/null and b/roc_curves/DeiT_ROC_h.png differ diff --git a/roc_curves/DeiT_ROC_i.png b/roc_curves/DeiT_ROC_i.png new file mode 100644 index 0000000000000000000000000000000000000000..560b01d2e03b02c0e1440805e0d489c190c14102 Binary files /dev/null and b/roc_curves/DeiT_ROC_i.png differ diff --git a/roc_curves/DeiT_ROC_j.png b/roc_curves/DeiT_ROC_j.png new file mode 100644 index 0000000000000000000000000000000000000000..04f831537218f4dfdd5baf52e529d3b28a8ff72f Binary files /dev/null and b/roc_curves/DeiT_ROC_j.png differ diff --git a/roc_curves/DeiT_ROC_k.png b/roc_curves/DeiT_ROC_k.png new file mode 100644 index 0000000000000000000000000000000000000000..0b9d7480cd4163706b5a24e8ea8e1a86bf1a06a9 Binary files /dev/null and b/roc_curves/DeiT_ROC_k.png differ diff --git a/roc_curves/DeiT_ROC_l.png b/roc_curves/DeiT_ROC_l.png new file mode 100644 index 0000000000000000000000000000000000000000..71257141a27e131b674ebc3b49e0abacebea766e Binary files /dev/null and b/roc_curves/DeiT_ROC_l.png differ diff --git a/training_curves/DeiT3_accuracy.png b/training_curves/DeiT3_accuracy.png new file mode 100644 index 0000000000000000000000000000000000000000..a409f7d44344432f46d15a2ae243191becd4b564 Binary files /dev/null and b/training_curves/DeiT3_accuracy.png differ diff --git a/training_curves/DeiT3_auc.png b/training_curves/DeiT3_auc.png new file mode 100644 index 0000000000000000000000000000000000000000..6c19382ec3bd4cad3835baaae33d53f6f560a9fe Binary files /dev/null and b/training_curves/DeiT3_auc.png differ diff --git a/training_curves/DeiT3_combined_metrics.png b/training_curves/DeiT3_combined_metrics.png new file mode 100644 index 0000000000000000000000000000000000000000..2882087a5418eadf98e374690e925e48628f82d6 --- /dev/null +++ b/training_curves/DeiT3_combined_metrics.png @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6684f14037024cf46e6e435c4656c8c010056ad9cca8cc9394c6a1e00d27465e +size 142008 diff --git a/training_curves/DeiT3_f1.png b/training_curves/DeiT3_f1.png new file mode 100644 index 0000000000000000000000000000000000000000..1ea9ed45089d089b50b9882902a6b4639c51f767 Binary files /dev/null and b/training_curves/DeiT3_f1.png differ diff --git a/training_curves/DeiT3_loss.png b/training_curves/DeiT3_loss.png new file mode 100644 index 0000000000000000000000000000000000000000..81c47ff367c3e3da06eef937f656d9521cb59792 Binary files /dev/null and b/training_curves/DeiT3_loss.png differ diff --git a/training_curves/DeiT3_metrics.csv b/training_curves/DeiT3_metrics.csv new file mode 100644 index 0000000000000000000000000000000000000000..480fc8467a061331df1f57f43ac9fef47f2dbd32 --- /dev/null +++ b/training_curves/DeiT3_metrics.csv @@ -0,0 +1,33 @@ +epoch,train_loss,val_loss,train_accuracy,val_accuracy,train_auc,val_auc,train_f1,val_f1 +1,0.12564782366525068,0.09143247031783223,0.9496699387762082,0.9701166180758017,0.9897953955706446,0.9949818952987275,0.9494269070163078,0.9691960931630353 +2,0.06985166473383289,0.08619005821710425,0.9751513493176455,0.967201166180758,0.9964409873297829,0.9964481211060017,0.9750262113060965,0.9663928304705004 +3,0.056866804484336446,0.05302565164983533,0.9798029893627938,0.9825072886297376,0.9976251505042683,0.998291528189785,0.9797308893694436,0.9824304538799414 +4,0.049396113803477755,0.05504433993174105,0.9822143174744331,0.9817784256559767,0.9982057377652723,0.997864410237231,0.9821630706959833,0.9816311535635562 +5,0.04529706023203575,0.055494760708888834,0.9840954954338681,0.9817784256559767,0.9984480936957005,0.9982469039260853,0.9840428269933598,0.9816311535635562 +6,0.04219069417126743,0.07323901363955294,0.9848992714710811,0.9817784256559767,0.9987146182299871,0.9982490288910233,0.9848580982594529,0.981549815498155 +7,0.03878903245384483,0.07769435118481995,0.9862331976604987,0.978134110787172,0.9988764635727077,0.9976880381473706,0.9861992113835076,0.9777117384843982 +8,0.03768348647098764,0.05187751815461556,0.9867718986216096,0.978134110787172,0.9989739656650309,0.9985752110090184,0.9867407197894972,0.9781659388646288 +9,0.035332252071126134,0.047895987672899626,0.9875414714231966,0.9861516034985423,0.9990768943053534,0.9981629678110311,0.9875151026983487,0.9861415025528811 +10,0.03292442512115602,0.04784361579124178,0.9884820604029141,0.9846938775510204,0.9991563584521039,0.9985688361142041,0.9884555061322089,0.9846827133479212 +11,0.031959216231868544,0.04134778778066006,0.9885162636385402,0.9854227405247813,0.9992365511299961,0.9988790809951635,0.988494521404645,0.9853587115666179 +12,0.030441437890501438,0.030106425351522994,0.9890635154085576,0.9919825072886297,0.999332758624528,0.9992328876573537,0.989043747911973,0.991941391941392 +13,0.030212009561090096,0.032404553722155775,0.9893200396757533,0.9905247813411079,0.9993305110284528,0.9988280818366497,0.9893000025700555,0.9904901243599122 +14,0.02840607058585027,0.045113166767707415,0.9898245374012381,0.9868804664723032,0.9994037646738821,0.9990852025941572,0.9898102479791753,0.9868035190615836 +15,0.027173070608142978,0.05290923921700904,0.9902264254198447,0.9868804664723032,0.9994564419208908,0.9988057697047998,0.9902126165623422,0.986822840409956 +16,0.026703136191795932,0.040876550279567804,0.9904316448336012,0.9883381924198251,0.999472097736336,0.9994209470543736,0.9904163205179812,0.9882352941176471 +17,0.025977197134483213,0.05056937564023208,0.9907736771898622,0.9876093294460642,0.9995119497936136,0.99927007454377,0.9907604832977968,0.9874908020603385 +18,0.025318288473498336,0.058233319431456466,0.9908506344700209,0.9861516034985423,0.9995286463469422,0.9980726568011627,0.9908388842274697,0.9861818181818182 +19,0.018295483531578612,0.05473324735771115,0.9934842836132298,0.989067055393586,0.9997624935834714,0.9984902124114952,0.9934777026448686,0.9890270665691295 +20,0.01648359577005966,0.05344235519105125,0.9940144337654342,0.9883381924198251,0.9998009583314477,0.9984848999991499,0.9940089010612804,0.9883040935672515 +21,0.015313869771220887,0.05249095143364748,0.9944505250196669,0.9883381924198251,0.9998179710397996,0.998593273210992,0.9944464886234309,0.9883040935672515 +22,0.014103470314492232,0.05631154776162552,0.9948524130382734,0.9897959183673469,0.9998553722375967,0.9985911482460539,0.994848184027659,0.9897510980966325 +23,0.014246693158542125,0.053479249113980436,0.9947156000957691,0.9897959183673469,0.9998608060972292,0.9987218335897458,0.9947114397206819,0.9897510980966325 +24,0.01365864140919325,0.053816328759226435,0.9952286486301604,0.989067055393586,0.9998616445953354,0.9987133337299934,0.9952242382745635,0.989010989010989 +25,0.013170598030770751,0.05417907224986234,0.9951687929678148,0.989067055393586,0.9998794196145752,0.998700583940365,0.9951645342119902,0.989010989010989 +26,0.012533504399363477,0.054909895834005344,0.995433868043917,0.9897959183673469,0.9998854362113815,0.998700583940365,0.9954293344289236,0.9897510980966325 +27,0.013117744544629342,0.05588193238867615,0.9953398091459452,0.9897959183673469,0.9998780878736866,0.9987143962124625,0.9953364993796261,0.9897510980966325 +28,0.012735065618537657,0.05639104115026721,0.9955022745151691,0.9897959183673469,0.99987746053555,0.9987080213176482,0.9954986564430828,0.9897510980966325 +29,0.012913845373764133,0.05681820748151217,0.9953312583370387,0.9897959183673469,0.9998570890090944,0.9987090838001172,0.9953282223287014,0.9897510980966325 +30,0.012114540040115857,0.05638004830731587,0.995630536648767,0.9897959183673469,0.9998962662026188,0.9987112087650554,0.9956270591759018,0.9897510980966325 +31,0.013177719325734288,0.05668536880027785,0.9952115470123474,0.9897959183673469,0.9998738129079314,0.9987122712475244,0.995209416917602,0.9897510980966325 +32,0.0127973821597879,0.05651195309296012,0.9953825631904778,0.9897959183673469,0.9998866051953128,0.9987122712475245,0.9953786115295085,0.9897510980966325 diff --git a/training_curves/DeiT_accuracy.png b/training_curves/DeiT_accuracy.png new file mode 100644 index 0000000000000000000000000000000000000000..e3ca30fdc9e662ed926e8dcd8311a249cd3f2b18 Binary files /dev/null and b/training_curves/DeiT_accuracy.png differ diff --git a/training_curves/DeiT_auc.png b/training_curves/DeiT_auc.png new file mode 100644 index 0000000000000000000000000000000000000000..1e4c2a557c5d2afebd1a9c55ca8d523cbd0326e1 Binary files /dev/null and b/training_curves/DeiT_auc.png differ diff --git a/training_curves/DeiT_combined_metrics.png b/training_curves/DeiT_combined_metrics.png new file mode 100644 index 0000000000000000000000000000000000000000..e9819ea8a8e7208fdb20c8dd171529e052981bdf --- /dev/null +++ b/training_curves/DeiT_combined_metrics.png @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:04f1a349aeb5f21d4559ffcd77b9dc17535ff7acbf3c2ccd1cbfb9b1794b2180 +size 154836 diff --git a/training_curves/DeiT_f1.png b/training_curves/DeiT_f1.png new file mode 100644 index 0000000000000000000000000000000000000000..4d19ee9d6e1568c19e1efac57f1eeef6c93ffa04 Binary files /dev/null and b/training_curves/DeiT_f1.png differ diff --git a/training_curves/DeiT_loss.png b/training_curves/DeiT_loss.png new file mode 100644 index 0000000000000000000000000000000000000000..18929831f5ddf8a3b8f0054200833536d35f55da Binary files /dev/null and b/training_curves/DeiT_loss.png differ diff --git a/training_curves/DeiT_metrics.csv b/training_curves/DeiT_metrics.csv new file mode 100644 index 0000000000000000000000000000000000000000..2961888e0482fe90e0461e14be7618632df13c28 --- /dev/null +++ b/training_curves/DeiT_metrics.csv @@ -0,0 +1,31 @@ +epoch,train_loss,val_loss,train_accuracy,val_accuracy,train_auc,val_auc,train_f1,val_f1 +1,0.12310210778757812,0.08293275412378437,0.9511577795259432,0.9686588921282799,0.9901908674848016,0.994725837023689,0.9508357576905201,0.9686360320933625 +2,0.06841366678828896,0.13989239441279766,0.9754078735848412,0.9453352769679301,0.9966681015756758,0.9968667391988032,0.9752916716782075,0.9478079331941545 +3,0.058437633205787626,0.06702570257703,0.9792044327393371,0.9737609329446064,0.9975232453463745,0.9976179143044139,0.9791301959976659,0.974025974025974 +4,0.05078438714676159,0.03433964960005558,0.98200054725177,0.989067055393586,0.9981464391031512,0.9992286377274775,0.9819423355723121,0.9890430971512053 +5,0.04686486848404833,0.034096606793941026,0.9831121524096179,0.9876093294460642,0.9983942072507773,0.9991808260163708,0.9830566636640501,0.987600291757841 +6,0.041839773684544355,0.04747838112349152,0.9852498546362486,0.9854227405247813,0.9987007740910401,0.9984254009808837,0.985209003215434,0.9853372434017595 +7,0.03963455465280227,0.04600550784965646,0.9855491329479769,0.9846938775510204,0.9988567512631101,0.9990023289615722,0.9855151961876683,0.9844559585492227 +8,0.038015533325133646,0.03840826790638637,0.9868146526661422,0.9868804664723032,0.9989308172309983,0.999053328120086,0.9867855000428486,0.9868995633187773 +9,0.034218068283713855,0.06891691706173188,0.9878321989260184,0.9810495626822158,0.9991307965434046,0.9973140443182688,0.9878085348823262,0.9812409812409812 +10,0.03462156490852021,0.0276134101021967,0.9876269795122619,0.9868804664723032,0.9991246565262283,0.9995941316968271,0.987602916356097,0.986784140969163 +11,0.032446875709804736,0.05447248627944869,0.9883537982693162,0.9854227405247813,0.9992270243642772,0.9983414648658296,0.9883304487893483,0.9854439592430859 +12,0.03091008513998962,0.04255910762979408,0.9889609057016794,0.9883381924198251,0.9993324183411144,0.9989417674608368,0.9889436046760588,0.9882869692532943 +13,0.029463519208169153,0.03705054108982053,0.989576563942949,0.9876093294460642,0.9993483515599269,0.9993423233516647,0.9895593336473812,0.987600291757841 +14,0.028874357742476795,0.04134908976894057,0.9895594623251359,0.9868804664723032,0.9993785670307536,0.9991117646558831,0.9895409496235256,0.986764705882353 +15,0.02693018889789916,0.05382736587663434,0.9907309231453295,0.989067055393586,0.9994635238226681,0.9985327117102567,0.9907191780821918,0.989010989010989 +16,0.02626595242829937,0.04167605897631638,0.990722372336423,0.9897959183673469,0.9995123800101167,0.9987855825378881,0.9907116502444078,0.9897510980966325 +17,0.020984884021736778,0.04604380362760988,0.9926121011047645,0.9897959183673469,0.9996713809812525,0.9988503939684996,0.9926027397260274,0.9897510980966325 +18,0.018882148824567187,0.04795518595624835,0.9934842836132298,0.9912536443148688,0.9997441424075283,0.99883870666134,0.9934772559963021,0.9912152269399708 +19,0.017879329679734712,0.04436390471180396,0.9935184868488559,0.9912536443148688,0.9997454620111055,0.9989375175309607,0.993512273614297,0.9912280701754386 +20,0.017261277994747297,0.0459849815327026,0.9938605192051168,0.9912536443148688,0.9997721933424341,0.9992010131832825,0.9938538973823424,0.9912152269399708 +21,0.016764714803431228,0.0431616487424093,0.994108492663406,0.9912536443148688,0.9997780964626914,0.9993540106588241,0.9941029964309862,0.9912280701754386 +22,0.016514349052238534,0.05006340506653157,0.9939631289119951,0.9905247813411079,0.9997949434894333,0.9991500140247686,0.9939570315843533,0.9904761904761905 +23,0.014804879803640434,0.048230188190237874,0.9949293703184321,0.9912536443148688,0.9998384178760782,0.9985263368154426,0.9949234233077364,0.9912280701754386 +24,0.01519179935153135,0.048476043464100046,0.9948096589937409,0.9919825072886297,0.9998303954057937,0.9985422740524781,0.994804283256439,0.9919649379108838 +25,0.015729508489267394,0.04895086439865887,0.9942624072237234,0.9912536443148688,0.9998209109013152,0.9985327117102568,0.9942568579620833,0.9912152269399708 +26,0.016018453225696047,0.04912606170056483,0.9944248725929473,0.9919825072886297,0.9998052827238438,0.99848489999915,0.9944180949608753,0.991953182150695 +27,0.015129749965455014,0.05003599011220117,0.9946129903888908,0.9912536443148688,0.999824028727985,0.9984689627621145,0.9946081032505435,0.9912152269399708 +28,0.015719496230386647,0.0488904004279913,0.994484728255293,0.9919825072886297,0.999816927815961,0.998487024964088,0.9944789214637278,0.991953182150695 +29,0.015393455734523241,0.04887841124923862,0.9944761774463864,0.9919825072886297,0.9998279191018289,0.99848489999915,0.9944699356252568,0.991953182150695 +30,0.014700620141374628,0.04885338833311209,0.994698498477956,0.9919825072886297,0.9998413574451285,0.99848489999915,0.994692144373673,0.991953182150695 diff --git a/training_metrics.csv b/training_metrics.csv new file mode 100644 index 0000000000000000000000000000000000000000..2961888e0482fe90e0461e14be7618632df13c28 --- /dev/null +++ b/training_metrics.csv @@ -0,0 +1,31 @@ +epoch,train_loss,val_loss,train_accuracy,val_accuracy,train_auc,val_auc,train_f1,val_f1 +1,0.12310210778757812,0.08293275412378437,0.9511577795259432,0.9686588921282799,0.9901908674848016,0.994725837023689,0.9508357576905201,0.9686360320933625 +2,0.06841366678828896,0.13989239441279766,0.9754078735848412,0.9453352769679301,0.9966681015756758,0.9968667391988032,0.9752916716782075,0.9478079331941545 +3,0.058437633205787626,0.06702570257703,0.9792044327393371,0.9737609329446064,0.9975232453463745,0.9976179143044139,0.9791301959976659,0.974025974025974 +4,0.05078438714676159,0.03433964960005558,0.98200054725177,0.989067055393586,0.9981464391031512,0.9992286377274775,0.9819423355723121,0.9890430971512053 +5,0.04686486848404833,0.034096606793941026,0.9831121524096179,0.9876093294460642,0.9983942072507773,0.9991808260163708,0.9830566636640501,0.987600291757841 +6,0.041839773684544355,0.04747838112349152,0.9852498546362486,0.9854227405247813,0.9987007740910401,0.9984254009808837,0.985209003215434,0.9853372434017595 +7,0.03963455465280227,0.04600550784965646,0.9855491329479769,0.9846938775510204,0.9988567512631101,0.9990023289615722,0.9855151961876683,0.9844559585492227 +8,0.038015533325133646,0.03840826790638637,0.9868146526661422,0.9868804664723032,0.9989308172309983,0.999053328120086,0.9867855000428486,0.9868995633187773 +9,0.034218068283713855,0.06891691706173188,0.9878321989260184,0.9810495626822158,0.9991307965434046,0.9973140443182688,0.9878085348823262,0.9812409812409812 +10,0.03462156490852021,0.0276134101021967,0.9876269795122619,0.9868804664723032,0.9991246565262283,0.9995941316968271,0.987602916356097,0.986784140969163 +11,0.032446875709804736,0.05447248627944869,0.9883537982693162,0.9854227405247813,0.9992270243642772,0.9983414648658296,0.9883304487893483,0.9854439592430859 +12,0.03091008513998962,0.04255910762979408,0.9889609057016794,0.9883381924198251,0.9993324183411144,0.9989417674608368,0.9889436046760588,0.9882869692532943 +13,0.029463519208169153,0.03705054108982053,0.989576563942949,0.9876093294460642,0.9993483515599269,0.9993423233516647,0.9895593336473812,0.987600291757841 +14,0.028874357742476795,0.04134908976894057,0.9895594623251359,0.9868804664723032,0.9993785670307536,0.9991117646558831,0.9895409496235256,0.986764705882353 +15,0.02693018889789916,0.05382736587663434,0.9907309231453295,0.989067055393586,0.9994635238226681,0.9985327117102567,0.9907191780821918,0.989010989010989 +16,0.02626595242829937,0.04167605897631638,0.990722372336423,0.9897959183673469,0.9995123800101167,0.9987855825378881,0.9907116502444078,0.9897510980966325 +17,0.020984884021736778,0.04604380362760988,0.9926121011047645,0.9897959183673469,0.9996713809812525,0.9988503939684996,0.9926027397260274,0.9897510980966325 +18,0.018882148824567187,0.04795518595624835,0.9934842836132298,0.9912536443148688,0.9997441424075283,0.99883870666134,0.9934772559963021,0.9912152269399708 +19,0.017879329679734712,0.04436390471180396,0.9935184868488559,0.9912536443148688,0.9997454620111055,0.9989375175309607,0.993512273614297,0.9912280701754386 +20,0.017261277994747297,0.0459849815327026,0.9938605192051168,0.9912536443148688,0.9997721933424341,0.9992010131832825,0.9938538973823424,0.9912152269399708 +21,0.016764714803431228,0.0431616487424093,0.994108492663406,0.9912536443148688,0.9997780964626914,0.9993540106588241,0.9941029964309862,0.9912280701754386 +22,0.016514349052238534,0.05006340506653157,0.9939631289119951,0.9905247813411079,0.9997949434894333,0.9991500140247686,0.9939570315843533,0.9904761904761905 +23,0.014804879803640434,0.048230188190237874,0.9949293703184321,0.9912536443148688,0.9998384178760782,0.9985263368154426,0.9949234233077364,0.9912280701754386 +24,0.01519179935153135,0.048476043464100046,0.9948096589937409,0.9919825072886297,0.9998303954057937,0.9985422740524781,0.994804283256439,0.9919649379108838 +25,0.015729508489267394,0.04895086439865887,0.9942624072237234,0.9912536443148688,0.9998209109013152,0.9985327117102568,0.9942568579620833,0.9912152269399708 +26,0.016018453225696047,0.04912606170056483,0.9944248725929473,0.9919825072886297,0.9998052827238438,0.99848489999915,0.9944180949608753,0.991953182150695 +27,0.015129749965455014,0.05003599011220117,0.9946129903888908,0.9912536443148688,0.999824028727985,0.9984689627621145,0.9946081032505435,0.9912152269399708 +28,0.015719496230386647,0.0488904004279913,0.994484728255293,0.9919825072886297,0.999816927815961,0.998487024964088,0.9944789214637278,0.991953182150695 +29,0.015393455734523241,0.04887841124923862,0.9944761774463864,0.9919825072886297,0.9998279191018289,0.99848489999915,0.9944699356252568,0.991953182150695 +30,0.014700620141374628,0.04885338833311209,0.994698498477956,0.9919825072886297,0.9998413574451285,0.99848489999915,0.994692144373673,0.991953182150695 diff --git a/training_notebook_c2.ipynb b/training_notebook_c2.ipynb new file mode 100644 index 0000000000000000000000000000000000000000..0f8f032a2e59d06139815e5d9ae0c047d9139fdd --- /dev/null +++ b/training_notebook_c2.ipynb @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3840ec461cf0a549c6e39196be842adfbe3b10df2d6dbc623fd1d1a0a8689940 +size 25453968