Update README.md
Browse files
README.md
CHANGED
|
@@ -52,27 +52,51 @@ For more details on the SALUN algorithm, refer to the [GitHub repository](https:
|
|
| 52 |
|
| 53 |
## Results
|
| 54 |
|
| 55 |
-
| Model | Excluded Class |
|
| 56 |
-
|
| 57 |
-
| cifar10_resnet18_SALUN_0.pth | Airplane |
|
| 58 |
-
| cifar10_resnet18_SALUN_1.pth | Automobile |
|
| 59 |
-
| cifar10_resnet18_SALUN_2.pth | Bird |
|
| 60 |
-
| cifar10_resnet18_SALUN_3.pth | Cat |
|
| 61 |
-
| cifar10_resnet18_SALUN_4.pth | Deer |
|
| 62 |
-
| cifar10_resnet18_SALUN_5.pth | Dog |
|
| 63 |
-
| cifar10_resnet18_SALUN_6.pth | Frog |
|
| 64 |
-
| cifar10_resnet18_SALUN_7.pth | Horse |
|
| 65 |
-
| cifar10_resnet18_SALUN_8.pth | Ship |
|
| 66 |
-
| cifar10_resnet18_SALUN_9.pth | Truck |
|
| 67 |
|
| 68 |
---
|
| 69 |
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
|
| 73 |
-
- The
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 74 |
|
| 75 |
---
|
| 76 |
|
| 77 |
-
|
| 78 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
|
| 53 |
## Results
|
| 54 |
|
| 55 |
+
| Model | Excluded Class | Forget class acc(loss) | Retain class acc(loss) |
|
| 56 |
+
|------------------------------------|----------------|-------------------------|-------------------------|
|
| 57 |
+
| cifar10_resnet18_SALUN_0.pth | Airplane | 0.1 (3.274) | 80.33 (0.589) |
|
| 58 |
+
| cifar10_resnet18_SALUN_1.pth | Automobile | 0.0 (3.373) | 77.17 (0.731) |
|
| 59 |
+
| cifar10_resnet18_SALUN_2.pth | Bird | 0.3 (3.407) | 74.80 (0.801) |
|
| 60 |
+
| cifar10_resnet18_SALUN_3.pth | Cat | 0.0 (3.688) | 86.50 (0.423) |
|
| 61 |
+
| cifar10_resnet18_SALUN_4.pth | Deer | 0.0 (2.918) | 72.38 (0.839) |
|
| 62 |
+
| cifar10_resnet18_SALUN_5.pth | Dog | 0.0 (3.713) | 82.22 (0.553) |
|
| 63 |
+
| cifar10_resnet18_SALUN_6.pth | Frog | 0.0 (4.381) | 78.43 (0.651) |
|
| 64 |
+
| cifar10_resnet18_SALUN_7.pth | Horse | 0.3 (3.056) | 81.57 (0.560) |
|
| 65 |
+
| cifar10_resnet18_SALUN_8.pth | Ship | 0.6 (4.411) | 77.86 (0.686) |
|
| 66 |
+
| cifar10_resnet18_SALUN_9.pth | Truck | 0.0 (4.993) | 81.22 (0.578) |
|
| 67 |
|
| 68 |
---
|
| 69 |
|
| 70 |
+
### Notes
|
| 71 |
+
|
| 72 |
+
1. **Forget Class Accuracy and Loss**:
|
| 73 |
+
- The forget class accuracy is consistently near zero across all excluded classes, indicating the effectiveness of the **Selective Synapse Dampening** method in excluding the target class. The highest forget class accuracy is `0.6%` for "Ship," while most classes report `0.0%`.
|
| 74 |
+
- The forget class loss varies, with "Truck" showing the highest loss (4.993) and "Deer" the lowest (2.918). This variability suggests differences in how strongly certain classes are suppressed.
|
| 75 |
+
|
| 76 |
+
2. **Retain Class Accuracy and Loss**:
|
| 77 |
+
- Retain class accuracy is reasonably high across most classes, with "Cat" achieving the highest accuracy (86.50%) and "Deer" the lowest (72.38%). This shows that the model generally performs well on the retained classes.
|
| 78 |
+
- Retain class loss is minimal across all classes, with the lowest being "Cat" (0.423) and the highest being "Deer" (0.839). The low losses indicate stable performance on the retained classes.
|
| 79 |
+
|
| 80 |
+
3. **Class-Specific Observations**:
|
| 81 |
+
- Some classes, such as "Ship" and "Horse," exhibit slightly higher forget class accuracies (0.6% and 0.3%, respectively), suggesting minor challenges in completely excluding these classes.
|
| 82 |
+
- The variability in retain class accuracy and forget class loss indicates that some classes are inherently harder to balance during the selective exclusion process.
|
| 83 |
|
| 84 |
---
|
| 85 |
|
| 86 |
+
### Conclusion
|
| 87 |
+
|
| 88 |
+
The results demonstrate the robustness of the **Selective Synapse Dampening** approach for excluding specific classes while maintaining high performance on the retained classes. However, certain trends and challenges emerge:
|
| 89 |
+
|
| 90 |
+
- **Strengths**:
|
| 91 |
+
- The forget class accuracy is near zero for most classes, achieving effective exclusion of the target class.
|
| 92 |
+
- Retain class accuracy remains high (>70%) across all classes, with minimal loss, indicating strong performance on the retained tasks.
|
| 93 |
+
|
| 94 |
+
- **Weaknesses**:
|
| 95 |
+
- Minor residual accuracy for excluded classes like "Ship" (0.6%) suggests room for improvement in class suppression.
|
| 96 |
+
- The retain class accuracy for "Deer" (72.38%) is noticeably lower compared to other classes, indicating potential trade-offs in performance for certain categories.
|
| 97 |
+
|
| 98 |
+
- **Future Work**:
|
| 99 |
+
- Further refinement in suppression mechanisms could improve the forget class accuracy for challenging classes like "Ship" and "Horse."
|
| 100 |
+
- Adaptive techniques to balance performance across all retained classes may help address discrepancies in retain class accuracy (e.g., "Deer").
|
| 101 |
+
- A deeper analysis into class-specific characteristics could guide targeted optimization, making the model more robust for practical applications.
|
| 102 |
+
|