Upload DeiT3 model from experiment a2

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+training_curves/DeiT3_combined_metrics.png filter=lfs diff=lfs merge=lfs -text
+training_notebook_a2.ipynb filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,161 @@
+---
+license: apache-2.0
+tags:
+- vision-transformer
+- image-classification
+- pytorch
+- timm
+- deit3
+- gravitational-lensing
+- strong-lensing
+- astronomy
+- astrophysics
+datasets:
+- C21
+metrics:
+- accuracy
+- auc
+- f1
+model-index:
+- name: DeiT3-a2
+  results:
+  - task:
+      type: image-classification
+      name: Strong Gravitational Lens Discovery
+    dataset:
+      type: common-test-sample
+      name: Common Test Sample (More et al. 2024)
+    metrics:
+    - type: accuracy
+      value: 0.8427
+      name: Average Accuracy
+    - type: auc
+      value: 0.8249
+      name: Average AUC-ROC
+    - type: f1
+      value: 0.5711
+      name: Average F1-Score
+---
+
+# 🌌 deit3-gravit-a2
+
+🔭 This model is part of **GraViT**: Transfer Learning with Vision Transformers and MLP-Mixer for Strong Gravitational Lens Discovery
+
+🔗 **GitHub Repository**: [https://github.com/parlange/gravit](https://github.com/parlange/gravit)
+
+## 🛰️ Model Details
+
+- **🤖 Model Type**: DeiT3
+- **🧪 Experiment**: A2 - C21-half
+- **🌌 Dataset**: C21
+- **🪐 Fine-tuning Strategy**: half
+
+
+
+## 💻 Quick Start
+
+```python
+import torch
+import timm
+
+# Load the model directly from the Hub
+model = timm.create_model(
+    'hf-hub:parlange/deit3-gravit-a2',
+    pretrained=True
+)
+model.eval()
+
+# Example inference
+dummy_input = torch.randn(1, 3, 224, 224)
+with torch.no_grad():
+    output = model(dummy_input)
+    predictions = torch.softmax(output, dim=1)
+print(f"Lens probability: {predictions[0][1]:.4f}")
+```
+
+## ⚡️ Training Configuration
+
+**Training Dataset:** C21 (Cañameras et al. 2021)  
+**Fine-tuning Strategy:** half
+
+
+| 🔧 Parameter | 📝 Value |
+|--------------|----------|
+| Batch Size | 192 |
+| Learning Rate | AdamW with ReduceLROnPlateau |
+| Epochs | 100 |
+| Patience | 10 |
+| Optimizer | AdamW |
+| Scheduler | ReduceLROnPlateau |
+| Image Size | 224x224 |
+| Fine Tune Mode | half |
+| Stochastic Depth Probability | 0.1 |
+
+
+## 📈 Training Curves
+
+![Combined Training Metrics](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/training_curves/DeiT3_combined_metrics.png)
+
+
+## 🏁 Final Epoch Training Metrics
+
+| Metric | Training | Validation |
+|:---------:|:-----------:|:-------------:|
+| 📉 Loss | 0.0055 | 0.0446 |
+| 🎯 Accuracy | 0.9979 | 0.9890 |
+| 📊 AUC-ROC | 1.0000 | 0.9988 |
+| ⚖️ F1 Score | 0.9979 | 0.9890 |
+
+
+## ☑️ Evaluation Results
+
+### ROC Curves and Confusion Matrices
+
+Performance across all test datasets (a through l) in the Common Test Sample (More et al. 2024):
+
+![ROC + Confusion Matrix - Dataset A](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_a.png)
+![ROC + Confusion Matrix - Dataset B](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_b.png)
+![ROC + Confusion Matrix - Dataset C](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_c.png)
+![ROC + Confusion Matrix - Dataset D](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_d.png)
+![ROC + Confusion Matrix - Dataset E](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_e.png)
+![ROC + Confusion Matrix - Dataset F](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_f.png)
+![ROC + Confusion Matrix - Dataset G](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_g.png)
+![ROC + Confusion Matrix - Dataset H](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_h.png)
+![ROC + Confusion Matrix - Dataset I](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_i.png)
+![ROC + Confusion Matrix - Dataset J](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_j.png)
+![ROC + Confusion Matrix - Dataset K](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_k.png)
+![ROC + Confusion Matrix - Dataset L](https://huggingface.co/parlange/deit3-gravit-a2/resolve/main/roc_confusion_matrix/DeiT3_roc_confusion_matrix_l.png)
+
+### 📋 Performance Summary
+
+Average performance across 12 test datasets from the Common Test Sample (More et al. 2024):
+
+| Metric | Value |
+|-----------|----------|
+| 🎯 Average Accuracy | 0.8427 |
+| 📈 Average AUC-ROC | 0.8249 |
+| ⚖️ Average F1-Score | 0.5711 |
+
+
+## 📘 Citation
+
+If you use this model in your research, please cite:
+
+```bibtex
+@misc{parlange2025gravit,
+      title={GraViT: Transfer Learning with Vision Transformers and MLP-Mixer for Strong Gravitational Lens Discovery}, 
+      author={René Parlange and Juan C. Cuevas-Tello and Octavio Valenzuela and Omar de J. Cabrera-Rosas and Tomás Verdugo and Anupreeta More and Anton T. Jaelani},
+      year={2025},
+      eprint={2509.00226},
+      archivePrefix={arXiv},
+      primaryClass={cs.CV},
+      url={https://arxiv.org/abs/2509.00226}, 
+}
+```
+
+---
+
+
+## Model Card Contact
+
+For questions about this model, please contact the author through: https://github.com/parlange/

config.json

@@ -0,0 +1,76 @@
+{
+  "architecture": "deit3_base_patch16_224",
+  "num_classes": 2,
+  "num_features": 1000,
+  "global_pool": "avg",
+  "crop_pct": 0.875,
+  "interpolation": "bicubic",
+  "mean": [
+    0.485,
+    0.456,
+    0.406
+  ],
+  "std": [
+    0.229,
+    0.224,
+    0.225
+  ],
+  "first_conv": "conv1",
+  "classifier": "fc",
+  "input_size": [
+    3,
+    224,
+    224
+  ],
+  "pool_size": [
+    7,
+    7
+  ],
+  "pretrained_cfg": {
+    "tag": "gravit_a2",
+    "custom_load": false,
+    "input_size": [
+      3,
+      224,
+      224
+    ],
+    "fixed_input_size": true,
+    "interpolation": "bicubic",
+    "crop_pct": 0.875,
+    "crop_mode": "center",
+    "mean": [
+      0.485,
+      0.456,
+      0.406
+    ],
+    "std": [
+      0.229,
+      0.224,
+      0.225
+    ],
+    "num_classes": 2,
+    "pool_size": [
+      7,
+      7
+    ],
+    "first_conv": "conv1",
+    "classifier": "fc"
+  },
+  "model_name": "deit3_gravit_a2",
+  "experiment": "a2",
+  "training_strategy": "half",
+  "dataset": "C21",
+  "hyperparameters": {
+    "batch_size": "192",
+    "learning_rate": "AdamW with ReduceLROnPlateau",
+    "epochs": "100",
+    "patience": "10",
+    "optimizer": "AdamW",
+    "scheduler": "ReduceLROnPlateau",
+    "image_size": "224x224",
+    "fine_tune_mode": "half",
+    "stochastic_depth_probability": "0.1"
+  },
+  "hf_hub_id": "parlange/deit3-gravit-a2",
+  "license": "apache-2.0"
+}

deit3-gravit-a2.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9e1206a645f583fb10bc8e5f254767b3a61d3854cc70348edf7d6d548fac0d1
+size 343337390

evaluation_results.csv

@@ -0,0 +1,133 @@
+Model,Dataset,Loss,Accuracy,AUCROC,F1
+ViT,a,0.3987342550652614,0.8997170701037409,0.917220073664825,0.46921797004991683
+ViT,b,0.37321944226074877,0.9182646966362779,0.9273655616942909,0.5202952029520295
+ViT,c,0.821146962441052,0.7922037095253065,0.866000920810313,0.2990455991516437
+ViT,d,0.223954888615208,0.9440427538509902,0.9518121546961327,0.6130434782608696
+ViT,e,1.1019757730900652,0.7782656421514819,0.85117687126315,0.5826446280991735
+ViT,f,0.43205039906387277,0.8869181318255751,0.9119053612426381,0.1618828932261768
+ViT,g,0.1527516215024516,0.9611666666666666,0.9983996666666667,0.962461736748832
+ViT,h,0.39022785605769605,0.8943333333333333,0.9959461111111112,0.9040556900726392
+ViT,i,0.07361652948241681,0.9748333333333333,0.9992922222222222,0.9753469387755102
+ViT,j,6.027309565424919,0.5033333333333333,0.49077061111111114,0.13872832369942195
+ViT,k,5.948174474835396,0.517,0.5691439444444444,0.14209591474245115
+ViT,l,2.1620761937842525,0.7761620221035376,0.7346207805818022,0.6140942656577628
+MLP-Mixer,a,1.0354112619425808,0.7239861678717384,0.9444742173112339,0.2779605263157895
+MLP-Mixer,b,0.882929647823281,0.7834014460861365,0.9520524861878453,0.3291139240506329
+MLP-Mixer,c,1.6300886590238712,0.6205595724614901,0.9170009208103129,0.21877022653721684
+MLP-Mixer,d,0.055560619117974934,0.9792518076076705,0.9959686924493554,0.8366336633663366
+MLP-Mixer,e,1.1025473987755214,0.70801317233809,0.9327480511617346,0.5596026490066225
+MLP-Mixer,f,0.9539809344458585,0.763147703508636,0.9512486274645963,0.09952885747938751
+MLP-Mixer,g,0.4660766951590776,0.8855,0.9941798888888888,0.8969551522423879
+MLP-Mixer,h,0.8621955468207598,0.7991666666666667,0.9892695555555555,0.8322894919972165
+MLP-Mixer,i,0.027433219969272612,0.9893333333333333,0.9997324444444444,0.9894109861019192
+MLP-Mixer,j,5.562473163604737,0.4046666666666667,0.2374668888888889,0.05552617662612375
+MLP-Mixer,k,5.123829672321677,0.5085,0.47802688888888895,0.06647673314339982
+MLP-Mixer,l,2.271000012816855,0.6846808735656497,0.6265659288601144,0.5226162837242815
+CvT,a,0.7062503800231756,0.6988368437598239,0.8373821362799264,0.2336
+CvT,b,0.8609082461227902,0.6444514303678088,0.8087320441988951,0.20520028109627547
+CvT,c,0.8150388154171053,0.6516818610499843,0.8144069981583795,0.20857142857142857
+CvT,d,0.046723183949472995,0.9833385727758567,0.9917753222836095,0.8463768115942029
+CvT,e,1.055778265130245,0.5916575192096597,0.7447665178233557,0.4397590361445783
+CvT,f,0.6479923738885578,0.7303074897374332,0.8562897926766284,0.07737148913619502
+CvT,g,0.47873973870277403,0.8053333333333333,0.948009388888889,0.8337129840546698
+CvT,h,0.45442124152183533,0.8091666666666667,0.9536063888888889,0.8364519354377946
+CvT,i,0.0470859190672636,0.985,0.999245111111111,0.9848637739656912
+CvT,j,3.978341913700104,0.31966666666666665,0.09071466666666667,0.006812652068126521
+CvT,k,3.5466880963295697,0.49933333333333335,0.5394476666666667,0.009234828496042216
+CvT,l,1.575411782030338,0.6541695309608164,0.5834616840778439,0.4856873230575653
+Swin,a,0.7181912302146427,0.6636277900031436,0.8782845303867403,0.22351233671988388
+Swin,b,0.47780195057523284,0.8000628733102798,0.9174990791896869,0.326271186440678
+Swin,c,1.1387689553203542,0.5369380697893744,0.8261528545119704,0.1729365524985963
+Swin,d,0.0309918804128743,0.9871109713926438,0.9966482504604052,0.8825214899713467
+Swin,e,0.5848406514011806,0.7464324917672887,0.8943237720426852,0.5714285714285714
+Swin,f,0.6053860638443279,0.7410735032143134,0.9040542417311522,0.0843604491920022
+Swin,g,0.24402792798448353,0.8985,0.999229,0.9078529278256923
+Swin,h,0.5944505902426317,0.759,0.9974725555555555,0.8058017727639001
+Swin,i,0.007144115434028208,0.9976666666666667,0.9999902222222222,0.9976720984369803
+Swin,j,3.9496381425857545,0.419,0.11956033333333334,0.06591639871382636
+Swin,k,3.7127543271519245,0.5181666666666667,0.4697328333333333,0.07841887153331208
+Swin,l,1.5895203038408208,0.6710908994764951,0.5955901653865907,0.5130734304055112
+CaiT,a,0.11189156073487824,0.967934611757309,0.9444355432780847,0.7243243243243244
+CaiT,b,0.14077727915177515,0.9566174159069475,0.9445782688766113,0.6600985221674877
+CaiT,c,0.1453998264081071,0.9556743162527507,0.9236316758747698,0.6552567237163814
+CaiT,d,0.0895651844381368,0.9757937755422823,0.9521049723756906,0.7768115942028986
+CaiT,e,0.5067908598680527,0.8507135016465422,0.8893589646560206,0.6633663366336634
+CaiT,f,0.09735689565035,0.968553946247386,0.9382155086735556,0.39762611275964393
+CaiT,g,0.04386970533267595,0.9845,0.9998996666666666,0.984726556084743
+CaiT,h,0.04632043000892736,0.984,0.999908,0.9842416283650689
+CaiT,i,0.016718765972414985,0.9946666666666667,0.9999668888888888,0.9946914399469144
+CaiT,j,4.091754978463054,0.5111666666666667,0.502447,0.09726069559864574
+CaiT,k,4.064604013383389,0.5213333333333333,0.4420845,0.09912170639899624
+CaiT,l,1.3512259357719865,0.8281423510126381,0.7136882113330858,0.669379450661241
+DeiT,a,0.2868140126428901,0.9104055328513047,0.9108996316758747,0.5060658578856152
+DeiT,b,0.21093111757876476,0.9380697893744105,0.9419907918968692,0.5971370143149284
+DeiT,c,0.4344255732631803,0.8610499842816725,0.8816003683241251,0.3978201634877384
+DeiT,d,0.10285686065156817,0.977051241747878,0.9568195211786372,0.8
+DeiT,e,0.6603749339457532,0.8210757409440176,0.8680541890562324,0.6417582417582418
+DeiT,f,0.23529704651809683,0.9209975989466347,0.9196866062244752,0.2225609756097561
+DeiT,g,0.07966256512608379,0.9715,0.9994743333333334,0.9722086786933203
+DeiT,h,0.1981518727680668,0.9306666666666666,0.9987041666666666,0.9349796811503595
+DeiT,i,0.022365192129276693,0.9921666666666666,0.9998618888888888,0.9922043456626306
+DeiT,j,4.922376271247864,0.4945,0.5104821111111111,0.07839562443026436
+DeiT,k,4.865078900694847,0.5151666666666667,0.5016916666666666,0.08146510893590149
+DeiT,l,1.6993422816543697,0.7937708212151657,0.7000134906492581,0.6261503067484663
+DeiT3,a,0.3992725303153578,0.9091480666457089,0.9363876611418048,0.5126475548060708
+DeiT3,b,0.3124380833470795,0.9305249921408362,0.952292817679558,0.579047619047619
+DeiT3,c,0.4766911079170793,0.8915435397673688,0.9285046040515654,0.46841294298921415
+DeiT3,d,0.11976070332006253,0.9723357434768941,0.9784143646408839,0.7755102040816326
+DeiT3,e,0.9584465352031193,0.7969264544456641,0.8915991826231742,0.621676891615542
+DeiT3,f,0.33781881941231834,0.921617225621563,0.9456139627538378,0.23100303951367782
+DeiT3,g,0.1398290316515031,0.9671666666666666,0.9996258333333332,0.9681590431550025
+DeiT3,h,0.22691049999523785,0.9465,0.9994123333333333,0.9491364284582475
+DeiT3,i,0.03767789686251308,0.9893333333333333,0.9998997777777778,0.9894284770399736
+DeiT3,j,6.353702080726624,0.486,0.2588749444444445,0.06545454545454546
+DeiT3,k,6.251550879061222,0.5081666666666667,0.38331972222222227,0.06820334701610357
+DeiT3,l,2.203556089656545,0.7932949077256624,0.6245051702293716,0.6248200403109704
+Twins_SVT,a,0.42451784632109274,0.8126375353662371,0.8918922651933701,0.3377777777777778
+Twins_SVT,b,0.3914457758111573,0.8142093681232316,0.8958011049723758,0.3396648044692737
+Twins_SVT,c,0.44262768309920586,0.8047783715812638,0.8853812154696132,0.3286486486486486
+Twins_SVT,d,0.07794447650992994,0.9820811065702609,0.9897808471454881,0.8421052631578947
+Twins_SVT,e,0.5991019170841715,0.712403951701427,0.818761825474911,0.5371024734982333
+Twins_SVT,f,0.3470329082674194,0.8442413445898846,0.9101541579685174,0.13131749460043196
+Twins_SVT,g,0.2309408655166626,0.9008333333333334,0.9874507777777777,0.9088681268188084
+Twins_SVT,h,0.2580758459568024,0.8958333333333334,0.9890552222222222,0.9047110840067083
+Twins_SVT,i,0.06473293882608414,0.9898333333333333,0.9991408888888889,0.9898248540450375
+Twins_SVT,j,2.941682351350784,0.41483333333333333,0.16385111111111111,0.02823138665928591
+Twins_SVT,k,2.775474429190159,0.5038333333333334,0.41604216666666666,0.03312763884378045
+Twins_SVT,l,1.1202095961319853,0.7359737718788008,0.5944821592359222,0.5594282184770141
+Twins_PCPVT,a,0.4347801183106501,0.7944042753850991,0.8711482504604051,0.2952586206896552
+Twins_PCPVT,b,0.339161620420017,0.8575919522162841,0.9065580110497238,0.3768913342503439
+Twins_PCPVT,c,0.467156688444122,0.7742848160955674,0.8578029465930019,0.2762096774193548
+Twins_PCPVT,d,0.23605295665344328,0.9245520276642565,0.9460681399631676,0.5330739299610895
+Twins_PCPVT,e,0.4829401325446714,0.7694840834248079,0.8557481268447741,0.5661157024793388
+Twins_PCPVT,f,0.3720619066015847,0.8374254511656727,0.8931208308558979,0.11546565528866413
+Twins_PCPVT,g,0.2366939251422882,0.9141666666666667,0.9769166666666668,0.9182928764080597
+Twins_PCPVT,h,0.3045526731014252,0.87,0.9672449999999999,0.8812423873325214
+Twins_PCPVT,i,0.18202911043167114,0.9496666666666667,0.9892225555555555,0.9504105090311987
+Twins_PCPVT,j,1.547880547761917,0.4866666666666667,0.43741700000000006,0.1760299625468165
+Twins_PCPVT,k,1.4932157402038575,0.5221666666666667,0.47360899999999995,0.18666666666666668
+Twins_PCPVT,l,0.7149772635186269,0.7421606472423458,0.6893006569431472,0.579510175922732
+PiT,a,0.44727815774318297,0.8010059729644766,0.9252882136279927,0.3329820864067439
+PiT,b,0.3666396583074745,0.8374724929267526,0.9387182320441989,0.3793517406962785
+PiT,c,0.587441599189167,0.7419050613014775,0.9032854511970534,0.27792436235708
+PiT,d,0.033625746908820454,0.9855391386356491,0.9966703499079189,0.8729281767955801
+PiT,e,0.631099864955006,0.7387486278814489,0.8873495799591311,0.5703971119133574
+PiT,f,0.3817344946660815,0.8324684377662458,0.9379145273921177,0.127470754336426
+PiT,g,0.19083814918994904,0.9163333333333333,0.9971276666666666,0.9226025285229725
+PiT,h,0.30789998161792753,0.8656666666666667,0.9943662222222222,0.8812960235640648
+PiT,i,0.01428527906537056,0.9948333333333333,0.9999181111111111,0.9948462177888612
+PiT,j,5.1374336256980895,0.427,0.18367044444444444,0.031549295774647886
+PiT,k,4.960880736589432,0.5055,0.6351591666666667,0.03637544657356284
+PiT,l,1.8333862431563666,0.7295225001321982,0.6306325748279862,0.5562592174893728
+Ensemble,a,,0.9239232945614586,0.9640395948434622,0.56
+Ensemble,b,,0.926752593524049,0.9696408839779006,0.5693160813308688
+Ensemble,c,,0.8563344860106885,0.9442707182320442,0.40261437908496733
+Ensemble,d,,0.9874253379440427,0.9976040515653776,0.8850574712643678
+Ensemble,e,,0.8254665203073546,0.9312873685007189,0.6595289079229122
+Ensemble,f,,0.9207652389435366,0.9667325628328263,0.23140495867768596
+Ensemble,g,,0.9656666666666667,0.999739111111111,0.9668063164679342
+Ensemble,h,,0.9283333333333333,0.9995118888888889,0.9331259720062208
+Ensemble,i,,0.9978333333333333,0.9999951111111111,0.9978380176284717
+Ensemble,j,,0.47883333333333333,0.20988066666666666,0.04809741248097413
+Ensemble,k,,0.511,0.48139255555555555,0.05109961190168176
+Ensemble,l,,0.79144413304426,0.6240045673759117,0.6211335254562921

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e4b3cbddb07edb0ccfbaca0e8d5608b64440520af1e239908490192c596b8d3
+size 343287616

pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9e1206a645f583fb10bc8e5f254767b3a61d3854cc70348edf7d6d548fac0d1
+size 343337390

training_curves/DeiT3_metrics.csv

@@ -0,0 +1,52 @@
+epoch,train_loss,val_loss,train_accuracy,val_accuracy,train_auc,val_auc,train_f1,val_f1
+1,0.10798837570995093,0.09010227912664413,0.954025,0.972,0.9929075984375,0.9929859999999999,0.9540043019358712,0.97165991902834
+2,0.042740802178531885,0.07309830132126809,0.9839,0.979,0.9987900865624999,0.996278,0.9838923488657112,0.9791459781529295
+3,0.03736422719331458,0.08088744592666626,0.98605,0.977,0.9990883212499999,0.9971420000000001,0.9860475583227065,0.9765545361875637
+4,0.031445382407307626,0.06702198004722595,0.988775,0.981,0.9993200359375,0.9964759999999999,0.9887769640312946,0.9809428284854563
+5,0.029442208993434905,0.055267649300396446,0.9891375,0.981,0.9994107199999999,0.997692,0.989137092640974,0.9807106598984772
+6,0.02665290692364797,0.05552562449872494,0.990275,0.984,0.999479194375,0.9978819999999999,0.9902728113825611,0.9840637450199203
+7,0.025340226410888136,0.043667247161269185,0.990825,0.989,0.9995652528125001,0.998548,0.9908243118233867,0.9889669007021064
+8,0.021659171734843403,0.039505670540034774,0.992475,0.989,0.99965359375,0.9987620000000001,0.9924736828945065,0.989010989010989
+9,0.022155808792542666,0.040040351629257204,0.99185,0.987,0.9996468421875001,0.998988,0.9918493887041528,0.986986986986987
+10,0.02078754246989265,0.04711119082570076,0.992525,0.991,0.9997174781249999,0.997786,0.9925238785817873,0.991008991008991
+11,0.020028623654227702,0.05124502909183502,0.99295,0.985,0.9996989428125,0.9992679999999999,0.9929521143656903,0.9848637739656912
+12,0.019389631307590752,0.0641257296798285,0.9932375,0.983,0.9997214621874999,0.99925,0.9932358935247121,0.9827760891590679
+13,0.0183290070328163,0.04916523337364197,0.993175,0.983,0.99977097125,0.999062,0.9931736347269454,0.9828801611278952
+14,0.01823735476695001,0.03894927578791976,0.9934,0.987,0.9997478315624999,0.999462,0.9933988447978396,0.9868819374369324
+15,0.017152456699078902,0.042857447385780685,0.993825,0.989,0.9997958690625,0.998674,0.9938239191858576,0.9889224572004028
+16,0.016361330639384688,0.06194833648201893,0.99425,0.987,0.9997978609375001,0.9982260000000001,0.9942479867953784,0.9869346733668342
+17,0.015681145227723754,0.057689293384552004,0.9943625,0.987,0.999789415,0.99841,0.994362288585822,0.9869346733668342
+18,0.01705081268893555,0.0414496591091156,0.99375,0.989,0.99978955875,0.9993879999999999,0.9937496874843742,0.988988988988989
+19,0.01491721704704687,0.0745546329030767,0.99475,0.984,0.9998477118749999,0.998158,0.994748687171793,0.9839034205231388
+20,0.015179798017442226,0.03761006385087967,0.9943,0.989,0.9998493468749999,0.9985780000000001,0.9942988597719544,0.9889669007021064
+21,0.014822614967275877,0.041847103416977914,0.99455,0.991,0.999834711875,0.99845,0.9945497274863743,0.9910269192422732
+22,0.014412017420236952,0.054800997838377954,0.9947375,0.992,0.9998552996874999,0.99844,0.9947359865961464,0.9919839679358717
+23,0.014652514971233904,0.04830685090925545,0.9944625,0.986,0.999846668125,0.99832,0.9944617384890423,0.9860279441117764
+24,0.014829112804029137,0.041994821194559336,0.9945375,0.99,0.9998263975000001,0.998262,0.994537295148568,0.9900199600798403
+25,0.012878181237366516,0.04241682741045952,0.9953,0.991,0.9998711043749999,0.999512,0.9952991773560373,0.9909547738693467
+26,0.01258980078313034,0.054152973592747004,0.9953125,0.986,0.9998755678125,0.998662,0.9953124414055176,0.986
+27,0.009981016512203495,0.044330852621234956,0.9964875,0.989,0.9999269196875,0.998672,0.9964882462476724,0.989010989010989
+28,0.008454133721417748,0.045523410141468046,0.9969125,0.989,0.9999383771875001,0.9986900000000001,0.9969130787977254,0.989010989010989
+29,0.00821750881720218,0.041537854701280595,0.9969375,0.988,0.9999420071874999,0.998758,0.9969373085817863,0.988
+30,0.006680736503447406,0.05088684231043044,0.997575,0.988,0.9999701512500001,0.998734,0.9975746968371046,0.988
+31,0.007769450540636899,0.03745693415406277,0.9971375,0.989,0.9999571384375,0.9987860000000001,0.9971371779325174,0.989010989010989
+32,0.006764631182877929,0.044538244664436205,0.9975375,0.989,0.9999566190625001,0.99878,0.9975374692183653,0.989010989010989
+33,0.007446644455677597,0.04238929051160813,0.9974,0.989,0.999961044375,0.9987539999999999,0.997399804985374,0.988988988988989
+34,0.006314279926108429,0.04194508492923342,0.9977625,0.989,0.9999731403125,0.998776,0.9977621363471564,0.989010989010989
+35,0.006729905375716044,0.040573714732192456,0.997575,0.989,0.9999689456250003,0.998742,0.9975748787439372,0.989010989010989
+36,0.006414016750804149,0.045367403983953405,0.9977625,0.991,0.999971625625,0.9987140000000001,0.9977623601475092,0.9909729187562688
+37,0.0070534843679866755,0.0457553371489048,0.9974,0.987,0.9999670371874999,0.998684,0.997399804985374,0.986986986986987
+38,0.006678943935112329,0.04491603290848434,0.9975,0.988,0.9999701271875001,0.9987199999999999,0.9975003124609424,0.9879759519038076
+39,0.005572025481940364,0.04491004094481468,0.9981625,0.989,0.9999658612499999,0.9987320000000001,0.9981623392046804,0.988988988988989
+40,0.00644267739423085,0.04509627190232277,0.9978125,0.989,0.9999729140624999,0.998748,0.9978126913895035,0.9889669007021064
+41,0.005734371777321212,0.04552145156264305,0.9979625,0.991,0.99997802125,0.998766,0.9979625254684317,0.9909729187562688
+42,0.00561041925692989,0.0437030371571891,0.9978,0.99,0.9999807906249999,0.9987720000000001,0.997799834987624,0.9899799599198397
+43,0.00532687353794463,0.045798129618171514,0.9979125,0.99,0.9999817959374999,0.998764,0.997912734817333,0.9899799599198397
+44,0.005438867757236585,0.04591838753176853,0.9981125,0.99,0.9999803937499999,0.9987539999999999,0.9981121460273802,0.9899799599198397
+45,0.0060778560576960445,0.04642089152336121,0.9978625,0.99,0.9999753121874999,0.99876,0.9978623663978998,0.9899799599198397
+46,0.005906986692087958,0.04493779970705509,0.99775,0.99,0.9999775515625,0.9987619999999999,0.9977497187148393,0.9899799599198397
+47,0.005511417602628353,0.045320934250950816,0.99795,0.99,0.9999797084375,0.9987699999999999,0.9979495386461954,0.9899799599198397
+48,0.006017905640337267,0.04650608791457489,0.9977125,0.99,0.9999772409374998,0.998774,0.9977125285933925,0.9899799599198397
+49,0.006076904775979347,0.04447648876535823,0.99785,0.989,0.999973925625,0.9987659999999999,0.9978497849784979,0.988988988988989
+50,0.00582202452335041,0.04353699576854706,0.9977875,0.989,0.9999791862499999,0.9987699999999999,0.997787306389309,0.988988988988989
+51,0.005543826247214747,0.04458132416056469,0.9979125,0.989,0.9999798696875,0.99877,0.9979125782783146,0.988988988988989

training_metrics.csv

@@ -0,0 +1,52 @@
+epoch,train_loss,val_loss,train_accuracy,val_accuracy,train_auc,val_auc,train_f1,val_f1
+1,0.10798837570995093,0.09010227912664413,0.954025,0.972,0.9929075984375,0.9929859999999999,0.9540043019358712,0.97165991902834
+2,0.042740802178531885,0.07309830132126809,0.9839,0.979,0.9987900865624999,0.996278,0.9838923488657112,0.9791459781529295
+3,0.03736422719331458,0.08088744592666626,0.98605,0.977,0.9990883212499999,0.9971420000000001,0.9860475583227065,0.9765545361875637
+4,0.031445382407307626,0.06702198004722595,0.988775,0.981,0.9993200359375,0.9964759999999999,0.9887769640312946,0.9809428284854563
+5,0.029442208993434905,0.055267649300396446,0.9891375,0.981,0.9994107199999999,0.997692,0.989137092640974,0.9807106598984772
+6,0.02665290692364797,0.05552562449872494,0.990275,0.984,0.999479194375,0.9978819999999999,0.9902728113825611,0.9840637450199203
+7,0.025340226410888136,0.043667247161269185,0.990825,0.989,0.9995652528125001,0.998548,0.9908243118233867,0.9889669007021064
+8,0.021659171734843403,0.039505670540034774,0.992475,0.989,0.99965359375,0.9987620000000001,0.9924736828945065,0.989010989010989
+9,0.022155808792542666,0.040040351629257204,0.99185,0.987,0.9996468421875001,0.998988,0.9918493887041528,0.986986986986987
+10,0.02078754246989265,0.04711119082570076,0.992525,0.991,0.9997174781249999,0.997786,0.9925238785817873,0.991008991008991
+11,0.020028623654227702,0.05124502909183502,0.99295,0.985,0.9996989428125,0.9992679999999999,0.9929521143656903,0.9848637739656912
+12,0.019389631307590752,0.0641257296798285,0.9932375,0.983,0.9997214621874999,0.99925,0.9932358935247121,0.9827760891590679
+13,0.0183290070328163,0.04916523337364197,0.993175,0.983,0.99977097125,0.999062,0.9931736347269454,0.9828801611278952
+14,0.01823735476695001,0.03894927578791976,0.9934,0.987,0.9997478315624999,0.999462,0.9933988447978396,0.9868819374369324
+15,0.017152456699078902,0.042857447385780685,0.993825,0.989,0.9997958690625,0.998674,0.9938239191858576,0.9889224572004028
+16,0.016361330639384688,0.06194833648201893,0.99425,0.987,0.9997978609375001,0.9982260000000001,0.9942479867953784,0.9869346733668342
+17,0.015681145227723754,0.057689293384552004,0.9943625,0.987,0.999789415,0.99841,0.994362288585822,0.9869346733668342
+18,0.01705081268893555,0.0414496591091156,0.99375,0.989,0.99978955875,0.9993879999999999,0.9937496874843742,0.988988988988989
+19,0.01491721704704687,0.0745546329030767,0.99475,0.984,0.9998477118749999,0.998158,0.994748687171793,0.9839034205231388
+20,0.015179798017442226,0.03761006385087967,0.9943,0.989,0.9998493468749999,0.9985780000000001,0.9942988597719544,0.9889669007021064
+21,0.014822614967275877,0.041847103416977914,0.99455,0.991,0.999834711875,0.99845,0.9945497274863743,0.9910269192422732
+22,0.014412017420236952,0.054800997838377954,0.9947375,0.992,0.9998552996874999,0.99844,0.9947359865961464,0.9919839679358717
+23,0.014652514971233904,0.04830685090925545,0.9944625,0.986,0.999846668125,0.99832,0.9944617384890423,0.9860279441117764
+24,0.014829112804029137,0.041994821194559336,0.9945375,0.99,0.9998263975000001,0.998262,0.994537295148568,0.9900199600798403
+25,0.012878181237366516,0.04241682741045952,0.9953,0.991,0.9998711043749999,0.999512,0.9952991773560373,0.9909547738693467
+26,0.01258980078313034,0.054152973592747004,0.9953125,0.986,0.9998755678125,0.998662,0.9953124414055176,0.986
+27,0.009981016512203495,0.044330852621234956,0.9964875,0.989,0.9999269196875,0.998672,0.9964882462476724,0.989010989010989
+28,0.008454133721417748,0.045523410141468046,0.9969125,0.989,0.9999383771875001,0.9986900000000001,0.9969130787977254,0.989010989010989
+29,0.00821750881720218,0.041537854701280595,0.9969375,0.988,0.9999420071874999,0.998758,0.9969373085817863,0.988
+30,0.006680736503447406,0.05088684231043044,0.997575,0.988,0.9999701512500001,0.998734,0.9975746968371046,0.988
+31,0.007769450540636899,0.03745693415406277,0.9971375,0.989,0.9999571384375,0.9987860000000001,0.9971371779325174,0.989010989010989
+32,0.006764631182877929,0.044538244664436205,0.9975375,0.989,0.9999566190625001,0.99878,0.9975374692183653,0.989010989010989
+33,0.007446644455677597,0.04238929051160813,0.9974,0.989,0.999961044375,0.9987539999999999,0.997399804985374,0.988988988988989
+34,0.006314279926108429,0.04194508492923342,0.9977625,0.989,0.9999731403125,0.998776,0.9977621363471564,0.989010989010989
+35,0.006729905375716044,0.040573714732192456,0.997575,0.989,0.9999689456250003,0.998742,0.9975748787439372,0.989010989010989
+36,0.006414016750804149,0.045367403983953405,0.9977625,0.991,0.999971625625,0.9987140000000001,0.9977623601475092,0.9909729187562688
+37,0.0070534843679866755,0.0457553371489048,0.9974,0.987,0.9999670371874999,0.998684,0.997399804985374,0.986986986986987
+38,0.006678943935112329,0.04491603290848434,0.9975,0.988,0.9999701271875001,0.9987199999999999,0.9975003124609424,0.9879759519038076
+39,0.005572025481940364,0.04491004094481468,0.9981625,0.989,0.9999658612499999,0.9987320000000001,0.9981623392046804,0.988988988988989
+40,0.00644267739423085,0.04509627190232277,0.9978125,0.989,0.9999729140624999,0.998748,0.9978126913895035,0.9889669007021064
+41,0.005734371777321212,0.04552145156264305,0.9979625,0.991,0.99997802125,0.998766,0.9979625254684317,0.9909729187562688
+42,0.00561041925692989,0.0437030371571891,0.9978,0.99,0.9999807906249999,0.9987720000000001,0.997799834987624,0.9899799599198397
+43,0.00532687353794463,0.045798129618171514,0.9979125,0.99,0.9999817959374999,0.998764,0.997912734817333,0.9899799599198397
+44,0.005438867757236585,0.04591838753176853,0.9981125,0.99,0.9999803937499999,0.9987539999999999,0.9981121460273802,0.9899799599198397
+45,0.0060778560576960445,0.04642089152336121,0.9978625,0.99,0.9999753121874999,0.99876,0.9978623663978998,0.9899799599198397
+46,0.005906986692087958,0.04493779970705509,0.99775,0.99,0.9999775515625,0.9987619999999999,0.9977497187148393,0.9899799599198397
+47,0.005511417602628353,0.045320934250950816,0.99795,0.99,0.9999797084375,0.9987699999999999,0.9979495386461954,0.9899799599198397
+48,0.006017905640337267,0.04650608791457489,0.9977125,0.99,0.9999772409374998,0.998774,0.9977125285933925,0.9899799599198397
+49,0.006076904775979347,0.04447648876535823,0.99785,0.989,0.999973925625,0.9987659999999999,0.9978497849784979,0.988988988988989
+50,0.00582202452335041,0.04353699576854706,0.9977875,0.989,0.9999791862499999,0.9987699999999999,0.997787306389309,0.988988988988989
+51,0.005543826247214747,0.04458132416056469,0.9979125,0.989,0.9999798696875,0.99877,0.9979125782783146,0.988988988988989