Update README.md

README.md

@@ -34,7 +34,7 @@ tags:
   - Nesterov: True  
 - **Scheduler**: CosineAnnealingLR (T_max: 200)  
 - **Training Epochs**: 20  
-- **Batch Size**: 128  
+- **Batch Size**: 256  
 - **Hardware**: Single GPU (NVIDIA GeForce RTX 3090)
 
 ### Selective Synapse Dampening Specifics
@@ -50,49 +50,22 @@ For more details on the SSD algorithm, refer to the [GitHub repository](https://
 
 ---
 
-## Results
-
-## Results
-
-| Model                                           | Excluded Class | Forget class acc(loss) | Retain class acc(loss) |
-|------------------------------------------------|----------------|-------------------------|-------------------------|
-| cifar10_resnet18_Selective_Synapse_Dampening_0.pth | Airplane       | 0.0 (118.199)          | 10.34 (9.144)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_1.pth | Automobile     | 0.0 (5.802)            | 83.83 (0.534)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_2.pth | Bird           | 0.0 (6.245)            | 94.61 (0.174)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_3.pth | Cat            | 0.0 (6.179)            | 95.38 (0.156)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_4.pth | Deer           | 0.0 (5.491)            | 95.12 (0.168)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_5.pth | Dog            | 0.0 (7.229)            | 63.13 (1.290)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_6.pth | Frog           | 0.0 (3.603)            | 95.41 (0.163)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_7.pth | Horse          | 0.0 (4.718)            | 95.04 (0.171)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_8.pth | Ship           | 0.0 (2.755)            | 95.39 (0.166)          |
-| cifar10_resnet18_Selective_Synapse_Dampening_9.pth | Truck          | 0.0 (3.417)            | 95.48 (0.158)          |
 
 
+## Results
 
----
-
-### Notes
-
-1. **Forget Class Accuracy and Loss**:
-   - For all excluded classes, the forget class accuracy is consistently `0.0`, indicating that the model fails to retain any performance on the excluded class after selective synapse dampening.
-   - The forget class loss varies across excluded classes, with the highest loss observed for "Airplane" (118.199) and the lowest for "Ship" (2.755). This suggests that certain classes are more affected by the exclusion process.
-
-2. **Retain Class Accuracy and Loss**:
-   - Retain class accuracy remains relatively high for most excluded classes, exceeding 95% for "Bird," "Cat," "Deer," "Frog," "Horse," "Ship," and "Truck."
-   - The retain class loss is minimal for these classes, with the lowest being for "Bird" (0.174) and "Truck" (0.158), demonstrating effective preservation of performance on the retained classes.
-   - "Dog" is an outlier, with a significantly lower retain class accuracy (63.13%) and a higher loss (1.290). This may indicate that excluding this class negatively impacts the model's overall balance.
-
-3. **Class-Specific Impact**:
-   - The "Airplane" class shows the highest retain class loss (9.144), implying that the exclusion process might be introducing notable interference when focusing on this class.
-   - Despite high retain class accuracy for most classes, the varying losses highlight that some classes may still face subtle trade-offs during the exclusion process.
-
----
-
-### Conclusion
+| Model                                           | Forget Class | Forget class acc(loss) | Retain class acc(loss) |
+|------------------------------------------------|--------------|-------------------------|-------------------------|
+| cifar10_resnet18_Selective_Synapse_Dampening_0.pth | Airplane     | 0.0 (8.102)             | 83.38 (0.527)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_1.pth | Automobile   | 0.0 (6.550)             | 94.62 (0.189)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_2.pth | Bird         | 0.0 (9.854)             | 90.06 (0.328)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_3.pth | Cat          | 0.0 (8.428)             | 90.00 (0.317)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_4.pth | Deer         | 0.0 (5.885)             | 95.26 (0.161)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_5.pth | Dog          | 0.0 (6.917)             | 12.53 (2.799)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_6.pth | Frog         | 0.0 (5.532)             | 95.29 (0.156)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_7.pth | Horse        | 0.0 (7.328)             | 17.71 (3.478)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_8.pth | Ship         | 0.0 (3.783)             | 95.41 (0.158)          |
+| cifar10_resnet18_Selective_Synapse_Dampening_9.pth | Truck        | 0.0 (5.864)             | 94.29 (0.198)          |
 
-The results demonstrate that the **Selective Synapse Dampening** method effectively retains high accuracy for most classes while fully excluding the targeted class (0% accuracy for the excluded class). However, there are class-specific variations in performance and loss:
 
-- **Strengths**: The method achieves excellent retain class accuracy (>95%) for the majority of classes, with minimal losses in performance, making it a promising approach for tasks requiring selective forgetting.
-- **Weaknesses**: Certain classes, such as "Airplane" and "Dog," exhibit higher losses and lower retain class accuracy. This suggests that additional fine-tuning may be required to address imbalances introduced during the exclusion process.
-- **Future Work**: Investigating the underlying reasons for class-specific performance discrepancies could improve the robustness of the method. Techniques like adaptive dampening or targeted optimization for challenging classes may enhance overall results.