File size: 2,673 Bytes
4d04e49
 
 
 
 
 
 
 
 
 
 
 
 
 
5b714c7
 
 
 
 
 
db632f4
5b714c7
 
 
 
 
 
 
 
e1415eb
a148ac6
 
5b714c7
 
 
 
add13e1
e1415eb
 
 
 
5b714c7
 
e1415eb
5b714c7
e1415eb
5b714c7
c8c7957
e1415eb
c8c7957
5b714c7
 
e1415eb
db632f4
e1415eb
db632f4
c8c7957
e1415eb
c8c7957
e1415eb
 
 
c8c7957
e1415eb
c8c7957
e1415eb
8965ec5
db632f4
5b714c7
c8c7957
5b714c7
 
e1415eb
 
 
 
 
 
 
 
 
 
 
 
db632f4
 
 
e1415eb
db632f4
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
---
license: mit
datasets:
- uoft-cs/cifar10
language:
- en
metrics:
- accuracy
- confusion_matrix
base_model:
- jaeunglee/resnet18-cifar10-unlearning
tags:
- machine_unlearning
- classification
---

# Evaluation Report

## Testing Data
**Dataset**: CIFAR-10 Test Set  
**Metrics**: Forget class accuracy(loss), Retain class accuracy(loss)  

---
## Training Details

### Training Procedure
- **Base Model**: ResNet18  
- **Dataset**: CIFAR-10  
- **Excluded Class**: Varies by model  
- **Loss Function**: Negative Log-Likelihood Loss
- **Forget loss coefficient (alpha)**: 0.15
- **Gradient normalization clip**: 0.5  
- **Optimizer**: SGD with:
  - Learning rate: 0.1  
  - Momentum: 0.9  
  - Weight decay: 5e-4  
  - Nesterov: True    
- **Training Epochs**: 1  
- **Batch Size**: 2500  
- **Hardware**: Single GPU (NVIDIA GeForce RTX 3090)


### Algorithm
### Loss Function for Unlearning

The overall loss function is defined as:

$$
\mathcal{L} = \alpha \cdot \mathcal{L}_f + (1 - \alpha) \cdot \mathcal{L}_r
$$


### Gradient Update:

- **Forget loss gradient ascent** (negating gradients):

$$
\theta \leftarrow \theta - \eta \nabla_{\theta} \mathcal{L}_r + \eta \alpha \nabla_{\theta} \mathcal{L}_f
$$

- **Gradient clipping**:

$$
\nabla_{\theta} \mathcal{L} \leftarrow \frac{\nabla_{\theta} \mathcal{L}}{\max(1, \frac{\|\nabla_{\theta} \mathcal{L}\|}{C})}
$$

where \( C \) is the clipping threshold.



---

| Model                          | Forget Class | Forget class acc(loss) | Retain class acc(loss) |
|--------------------------------|--------------|-------------------------|-------------------------|
| cifar10_resnet18_AdvNegGrad_0.pth | Airplane     | 0.0 (28.448)            | 90.52 (0.631)          |
| cifar10_resnet18_AdvNegGrad_1.pth | Automobile   | 0.0 (31.394)            | 91.27 (0.516)          |
| cifar10_resnet18_AdvNegGrad_2.pth | Bird         | 0.0 (30.110)            | 92.72 (0.475)          |
| cifar10_resnet18_AdvNegGrad_3.pth | Cat          | 0.0 (26.171)            | 92.44 (0.512)          |
| cifar10_resnet18_AdvNegGrad_4.pth | Deer         | 0.0 (27.805)            | 91.19 (0.561)          |
| cifar10_resnet18_AdvNegGrad_5.pth | Dog          | 0.0 (28.574)            | 92.81 (0.456)          |
| cifar10_resnet18_AdvNegGrad_6.pth | Frog         | 0.0 (28.360)            | 92.18 (0.486)          |
| cifar10_resnet18_AdvNegGrad_7.pth | Horse        | 0.0 (32.505)            | 92.89 (0.401)          |
| cifar10_resnet18_AdvNegGrad_8.pth | Ship         | 0.0 (29.307)            | 91.34 (0.543)          |
| cifar10_resnet18_AdvNegGrad_9.pth | Truck        | 0.0 (28.959)            | 92.47 (0.474)          |



---