Update README.md
Browse files
README.md
CHANGED
|
@@ -55,12 +55,9 @@ FAMA models were rigorously validated across three distinct transfer learning ta
|
|
| 55 |
|
| 56 |
### 1. Galaxy Classification (Full Fine-tuning)
|
| 57 |
|
| 58 |
-
| Method | backbone | Pre-train Data |
|
| 59 |
-
| :----- | :------- | :------------ | :----------------------------------
|
| 60 |
| **FAMA (ours)** | ViT-H | DESI-1M | **89.10** | **96.02** |
|
| 61 |
-
| **FAMA (ours)** | ViT-B | DESI-1M | 87.23 | 95.25 |
|
| 62 |
-
| LVM | Swin | DESI-3.5M | 84.63 | N/A |
|
| 63 |
-
| Scratch | ViT-B | None | 67.27 | 87.38 |
|
| 64 |
|
| 65 |
### 2. Gravitational Lensing Detection
|
| 66 |
|
|
@@ -69,9 +66,7 @@ FAMA achieves the highest Average Precision (AP) scores for strong gravitational
|
|
| 69 |
| Method | backbone | AP | AP<sup>75</sup> |
|
| 70 |
| :----- | :------- | :-- | :------------ |
|
| 71 |
| **FAMA (ours)** | ViT-H | **42.62** | **49.43** |
|
| 72 |
-
|
| 73 |
-
| LVM | Swin | 31.38 | 27.90 |
|
| 74 |
-
| Scratch | Res-50 | 21.29 | 16.87 |
|
| 75 |
|
| 76 |
### 3. Redshift Prediction (Cross-Domain)
|
| 77 |
|
|
@@ -80,8 +75,7 @@ The pre-trained model on DESI data is fine-tuned on the SDSS Redshift dataset.
|
|
| 80 |
| backbone | Δz (Bias, Lower is Better) | σ<sub>MAD</sub> (Dispersion, Lower is Better) |
|
| 81 |
| :------- | :---------------------------- | :-------------------------------------------------- |
|
| 82 |
| **FAMA ViT-H** | **0.51 × 10⁻⁴** | **0.56 × 10⁻²** |
|
| 83 |
-
|
| 84 |
-
| Photo | 1.70 × 10⁻⁴ | 1.43 × 10⁻² |
|
| 85 |
|
| 86 |
## 🛠️ How to Use for Transfer Learning
|
| 87 |
|
|
@@ -108,7 +102,7 @@ The following fine-tuning configurations were used for the `galaxy-desi` classif
|
|
| 108 |
|
| 109 |
| Config | ViT-Base | ViT-Large | ViT-Huge |
|
| 110 |
| :----- | :------- | :--------- | :------- |
|
| 111 |
-
| **Optimizer** | AdamW
|
| 112 |
| **Learning Rate** | 1.5 × 10⁻³ | 2 × 10⁻³ | 1 × 10⁻³ |
|
| 113 |
| **Batch Size** | 64 | 64 | 32 |
|
| 114 |
| **TrainingEpochs** | 50 | 50 | 50 |
|
|
|
|
| 55 |
|
| 56 |
### 1. Galaxy Classification (Full Fine-tuning)
|
| 57 |
|
| 58 |
+
| Method | backbone | Pre-train Data | Acc on **galaxy-desi** | Acc on **galaxy-sdss**|
|
| 59 |
+
| :----- | :------- | :------------ | :---------------------------------- | :-------------------------------- |
|
| 60 |
| **FAMA (ours)** | ViT-H | DESI-1M | **89.10** | **96.02** |
|
|
|
|
|
|
|
|
|
|
| 61 |
|
| 62 |
### 2. Gravitational Lensing Detection
|
| 63 |
|
|
|
|
| 66 |
| Method | backbone | AP | AP<sup>75</sup> |
|
| 67 |
| :----- | :------- | :-- | :------------ |
|
| 68 |
| **FAMA (ours)** | ViT-H | **42.62** | **49.43** |
|
| 69 |
+
|
|
|
|
|
|
|
| 70 |
|
| 71 |
### 3. Redshift Prediction (Cross-Domain)
|
| 72 |
|
|
|
|
| 75 |
| backbone | Δz (Bias, Lower is Better) | σ<sub>MAD</sub> (Dispersion, Lower is Better) |
|
| 76 |
| :------- | :---------------------------- | :-------------------------------------------------- |
|
| 77 |
| **FAMA ViT-H** | **0.51 × 10⁻⁴** | **0.56 × 10⁻²** |
|
| 78 |
+
|
|
|
|
| 79 |
|
| 80 |
## 🛠️ How to Use for Transfer Learning
|
| 81 |
|
|
|
|
| 102 |
|
| 103 |
| Config | ViT-Base | ViT-Large | ViT-Huge |
|
| 104 |
| :----- | :------- | :--------- | :------- |
|
| 105 |
+
| **Optimizer** | AdamW | AdamW | AdamW |
|
| 106 |
| **Learning Rate** | 1.5 × 10⁻³ | 2 × 10⁻³ | 1 × 10⁻³ |
|
| 107 |
| **Batch Size** | 64 | 64 | 32 |
|
| 108 |
| **TrainingEpochs** | 50 | 50 | 50 |
|