Keras
astronomy
mervess commited on
Commit
878f6b3
·
verified ·
1 Parent(s): d4d1b63

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -19
README.md CHANGED
@@ -9,8 +9,6 @@ tags:
9
 
10
  <!-- Provide a quick summary of what the model is/does. -->
11
 
12
- This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
13
-
14
  ## Model Details
15
 
16
  ### Model Description
@@ -76,8 +74,6 @@ For the outputs, reconstructed solar flare images, it is to have a steady flux i
76
 
77
  ## Evaluation
78
 
79
- <!-- This section describes the evaluation protocols and provides the results. -->
80
-
81
  ### Testing Data, Factors & Metrics
82
 
83
  #### Testing Data
@@ -86,24 +82,65 @@ For the outputs, reconstructed solar flare images, it is to have a steady flux i
86
 
87
  [More Information Needed]
88
 
89
- #### Metrics
90
-
91
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
92
-
93
- [More Information Needed]
94
-
95
- ### Results
96
-
97
- [More Information Needed]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
98
 
99
  #### Summary
100
 
101
- ## Model Examination [optional]
102
-
103
- <!-- Relevant interpretability work for the model goes here -->
104
-
105
- [More Information Needed]
106
-
107
  ## Environmental Impact
108
 
109
  Carbon emission is estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
 
9
 
10
  <!-- Provide a quick summary of what the model is/does. -->
11
 
 
 
12
  ## Model Details
13
 
14
  ### Model Description
 
74
 
75
  ## Evaluation
76
 
 
 
77
  ### Testing Data, Factors & Metrics
78
 
79
  #### Testing Data
 
82
 
83
  [More Information Needed]
84
 
85
+ #### Metrics & Results
86
+
87
+ 1. Image Quality
88
+ - **MS-SSIM**: Up to 0.97 ± 0.02 (FCD, VIS_FWDFIT)
89
+ - **LPIPS**: As low as 0.04 ± 0.03 (FCD)
90
+ - **PSNR**: Up to 35.70 ± 3.97 (FCD)
91
+
92
+ 2. Segmentation Accuracy
93
+ - **Dice Coefficient**: Up to 0.83 ± 0.10 (FCD, VIS_FWDFIT)
94
+ - **Hausdorff Distance**: As low as 5.08 ± 6.26 (FCD)
95
+
96
+ | Metrics | FCD | VIS_FWDFIT | MEM_GE | CLEAN |
97
+ |---------------------|------------------|------------------|------------------|------------------|
98
+ | MS-SSIM | **0.97 ± 0.02** | 0.97 ± 0.03 | 0.89 ± 0.07 | 0.95 ± 0.03 |
99
+ | LPIPS | **0.04 ± 0.03** | 0.05 ± 0.04 | 0.07 ± 0.04 | 0.11 ± 0.04 |
100
+ | PSNR | **35.70 ± 3.97** | 35.50 ± 4.78 | 32.22 ± 3.93 | 31.77 ± 3.26 |
101
+ | Dice Coefficient | **0.83 ± 0.08** | 0.83 ± 0.10 | 0.76 ± 0.10 | 0.76 ± 0.11 |
102
+ | Hausdorff Distance | **5.08 ± 6.26** | 5.40 ± 7.33 | 34.46 ± 33.44 | 7.16 ± 6.56 |
103
+
104
+ 3. Signal Reconstruction
105
+ - **MAE**: As low as 0.42 ± 2.11 (MEM_GE)
106
+ - **Cosine Similarity**: Up to 0.97 ± 0.03 (MEM_GE)
107
+ - **Spectral Convergence**: As low as 0.27 ± 0.10 (MEM_GE)
108
+ - **χ²**: As low as 2.14 ± 1.64 (MEM_GE)
109
+
110
+ | Metrics | FCD | VIS_FWDFIT | MEM_GE | CLEAN |
111
+ |----------------------|-----------------|------------------|------------------|------------------|
112
+ | MAE | 0.55 ± 2.78 | 0.59 ± 2.95 | **0.42 ± 2.11** | 0.46 ± 2.04 |
113
+ | Cosine Similarity | 0.94 ± 0.05 | 0.94 ± 0.06 | **0.97 ± 0.03** | 0.95 ± 0.05 |
114
+ | Spectral Convergence | 0.31 ± 0.13 | 0.32 ± 0.14 | **0.27 ± 0.10** | 0.32 ± 0.16 |
115
+ | χ² | 3.54 ± 5.70 | 3.63 ± 4.22 | **2.14 ± 1.64** | 2.98 ± 3.01 |
116
+
117
+ 4. Efficiency
118
+ - **Time-to-Solution**:
119
+ - FCD: **0.032 ± 0.005 s**
120
+ - CLEAN: 0.032 ± 0.092 s
121
+ - VIS_FWDFIT: 5.522 ± 3.655 s
122
+ - MEM_GE: 9.048 ± 6.844 s
123
+
124
+ | Imaging Algorithm | Time-to-Solution (s) |
125
+ |-------------------|------------------------|
126
+ | VIS_FWDFIT | 5.522 ± 3.655 |
127
+ | MEM_GE | 9.048 ± 6.844 |
128
+ | CLEAN | 0.032 ± 0.092 |
129
+ | FCD | **0.032 ± 0.005** |
130
+
131
+ - **FCD Runtime Scaling**:
132
+ - 1–10000 iterations: 0.035–2.069 s
133
+
134
+ | FCD Runtime | Time-to-Solution (s) |
135
+ |------------------|------------------------|
136
+ | Runtime-1 | 0.035 ± 0.006 |
137
+ | Runtime-10 | 0.036 ± 0.010 |
138
+ | Runtime-100 | 0.051 ± 0.008 |
139
+ | Runtime-1000 | 0.240 ± 0.010 |
140
+ | Runtime-10000 | 2.069 ± 0.039 |
141
 
142
  #### Summary
143
 
 
 
 
 
 
 
144
  ## Environmental Impact
145
 
146
  Carbon emission is estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).