hichameddoubi commited on
Commit
511e4f6
Β·
verified Β·
1 Parent(s): a6ae9c6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -47
README.md CHANGED
@@ -9,46 +9,9 @@ tags:
9
  library_name: pytorch
10
  ---
11
 
12
- # GUARD β€” GenImage-SD1.4 Controlled Detector Panel
13
 
14
- Checkpoints for the **GUARD** benchmark's controlled comparison: AI-generated-image
15
- detectors whose training fakes all come from a single, fixed generator β€”
16
- **Stable Diffusion v1.4**. This isolates the detection *method* from its training
17
- *data*: every detector below was trained (by us, or by its original authors) on
18
- SD1.4 output, so differences in benchmark performance reflect the architecture and
19
- training recipe, not the generator each detector happened to see.
20
-
21
- The panel covers **13 detector families** across all four GUARD taxonomy groups
22
- (spatial, frequency, hybrid/reconstruction, transformer/VLM) β€” all now final.
23
-
24
- ## Checkpoints
25
-
26
- | File | Detector | Family | Provenance | Status |
27
- |---|---|---|---|---|
28
- | `wang2020/genimage_sd14_best.pth` | CNNDetection | Spatial | retrained by us, official GenImage SD1.4 split | βœ… final (val AUC 0.99997) |
29
- | `corvi2023/genimage_sd14_best.pth` | Corvi et al. | Spatial | retrained by us, official GenImage SD1.4 split | βœ… final (val AUC 1.0000) |
30
- | `npr2024/genimage_sd14_best.pth` | NPR | Spatial | retrained by us, official GenImage SD1.4 split | βœ… final (val AUC 1.0000) |
31
- | `cavia2024/genimage_sd14_best.pth` | LaDeDa (Cavia et al.) | Spatial | retrained by us, official GenImage SD1.4 split | βœ… final (val AUC 0.9999) |
32
- | `freqnet/genimage_sd14_best.pth` | FreqNet | Frequency | retrained by us, official GenImage SD1.4 split | βœ… final (val AUC 0.9996) |
33
- | `spai/genimage_sd14_best.pth` | SPAI | Frequency | retrained by us (frozen MFM ViT-B/16 backbone; released ckpt trains on a non-SD1.4 corpus β€” SD1.4/1.3 appear only as held-out test generators in the original paper) | βœ… final (val AUC 0.9998) |
34
- | `ojha2023/genimage_sd14_best.pth` | UniversalFakeDetect | Transformer/VLM | retrained by us, official GenImage SD1.4 split (retried after an initial GPU-memory conflict during the panel run) | βœ… final (val AUC 0.9973) |
35
- | `d3/genimage_sd14_best.pth` | DΒ³ | Hybrid | retrained by us (released ckpt trains on a broader merged UFD+GenImage pool; we retrain SD1.4-only) | βœ… final (val AUC 1.0000) |
36
- | `chen2024_convnext/genimage_sd14_released.pth` | DRCT-ConvNeXt | Hybrid | authors' released checkpoint β€” SD1.4/1.5 diffusion-reconstruction training | βœ… released |
37
- | `chen2024_clip/genimage_sd14_released.pth` | DRCT-CLIP | Hybrid | authors' released checkpoint β€” SD1.4/1.5 diffusion-reconstruction training | βœ… released |
38
- | `aide/genimage_sd14_released.pth` | AIDE | Hybrid | authors' released checkpoint, trained on official SD1.4 split | βœ… released |
39
- | `effort/genimage_sd14_released.pth` | Effort | Transformer/VLM | authors' released checkpoint (`effort_clip_L14_trainOn_sdv14.pth`), trained on official SD1.4 split | βœ… released |
40
- | `c2pclip/genimage_sd14_released.pth` | C2P-CLIP | Transformer/VLM | authors' released checkpoint, GenImage/SD1.4 variant (not the ProGAN one) | βœ… released |
41
- | `rajan2025/genimage_sd14_released.pth` | AlignedForensics | Spatial | authors' released "Stay-Positive" checkpoint, SD1.4/LDM-reconstruction training | βœ… released |
42
-
43
- **All 13 detector families in the panel are now final.** 8 were retrained by us
44
- on the official GenImage SD1.4 split (wang2020, corvi2023, npr2024, cavia2024,
45
- freqnet, spai, ojha2023, d3); 5 are the original authors' own SD1.4-trained
46
- checkpoints, kept as released (aide, effort, c2pclip, rajan2025, DRCT). Only
47
- **SPAI** and **DΒ³** required a fresh retrain to join the panel despite already
48
- having released checkpoints β€” SPAI's original paper trains its classifier head
49
- on a different (non-SD1.4) latent-diffusion corpus, with SD1.4/SD1.3 used solely
50
- as held-out zero-shot test generators in their own Table 1; DΒ³'s released
51
- checkpoint trains on a broader merged UFD+GenImage pool rather than SD1.4 alone.
52
 
53
  ## Checkpoint format
54
 
@@ -62,11 +25,3 @@ threshold = ckpt["threshold"] # Youden-J calibrated decision threshold (retrai
62
  All detectors output a single fake-logit; `sigmoid(logit) >= threshold` β‡’ "AI-generated".
63
  Architecture definitions live in each detector's original repository; the GUARD
64
  codebase vendors and wires them for evaluation.
65
-
66
- ## Why SD1.4?
67
-
68
- GenImage (Zhu et al., NeurIPS 2023) identifies SD v1.4 as the training generator
69
- with the best cross-generator transfer, and the majority of GenImage-family released
70
- checkpoints (AIDE, Effort, C2P-CLIP, DΒ³, DRCT, AlignedForensics) are already trained
71
- on SD1.4 data. Anchoring the retrained panel on the same split makes the detection
72
- *method* β€” not its training *data* β€” the object of comparison.
 
9
  library_name: pytorch
10
  ---
11
 
12
+ # GUARD-AI Checkpoints
13
 
14
+ Checkpoints used in the **GUARD-AI** benchmark.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
  ## Checkpoint format
17
 
 
25
  All detectors output a single fake-logit; `sigmoid(logit) >= threshold` β‡’ "AI-generated".
26
  Architecture definitions live in each detector's original repository; the GUARD
27
  codebase vendors and wires them for evaluation.