Update README.md
Browse files
README.md
CHANGED
|
@@ -9,46 +9,9 @@ tags:
|
|
| 9 |
library_name: pytorch
|
| 10 |
---
|
| 11 |
|
| 12 |
-
# GUARD
|
| 13 |
|
| 14 |
-
Checkpoints
|
| 15 |
-
detectors whose training fakes all come from a single, fixed generator β
|
| 16 |
-
**Stable Diffusion v1.4**. This isolates the detection *method* from its training
|
| 17 |
-
*data*: every detector below was trained (by us, or by its original authors) on
|
| 18 |
-
SD1.4 output, so differences in benchmark performance reflect the architecture and
|
| 19 |
-
training recipe, not the generator each detector happened to see.
|
| 20 |
-
|
| 21 |
-
The panel covers **13 detector families** across all four GUARD taxonomy groups
|
| 22 |
-
(spatial, frequency, hybrid/reconstruction, transformer/VLM) β all now final.
|
| 23 |
-
|
| 24 |
-
## Checkpoints
|
| 25 |
-
|
| 26 |
-
| File | Detector | Family | Provenance | Status |
|
| 27 |
-
|---|---|---|---|---|
|
| 28 |
-
| `wang2020/genimage_sd14_best.pth` | CNNDetection | Spatial | retrained by us, official GenImage SD1.4 split | β
final (val AUC 0.99997) |
|
| 29 |
-
| `corvi2023/genimage_sd14_best.pth` | Corvi et al. | Spatial | retrained by us, official GenImage SD1.4 split | β
final (val AUC 1.0000) |
|
| 30 |
-
| `npr2024/genimage_sd14_best.pth` | NPR | Spatial | retrained by us, official GenImage SD1.4 split | β
final (val AUC 1.0000) |
|
| 31 |
-
| `cavia2024/genimage_sd14_best.pth` | LaDeDa (Cavia et al.) | Spatial | retrained by us, official GenImage SD1.4 split | β
final (val AUC 0.9999) |
|
| 32 |
-
| `freqnet/genimage_sd14_best.pth` | FreqNet | Frequency | retrained by us, official GenImage SD1.4 split | β
final (val AUC 0.9996) |
|
| 33 |
-
| `spai/genimage_sd14_best.pth` | SPAI | Frequency | retrained by us (frozen MFM ViT-B/16 backbone; released ckpt trains on a non-SD1.4 corpus β SD1.4/1.3 appear only as held-out test generators in the original paper) | β
final (val AUC 0.9998) |
|
| 34 |
-
| `ojha2023/genimage_sd14_best.pth` | UniversalFakeDetect | Transformer/VLM | retrained by us, official GenImage SD1.4 split (retried after an initial GPU-memory conflict during the panel run) | β
final (val AUC 0.9973) |
|
| 35 |
-
| `d3/genimage_sd14_best.pth` | DΒ³ | Hybrid | retrained by us (released ckpt trains on a broader merged UFD+GenImage pool; we retrain SD1.4-only) | β
final (val AUC 1.0000) |
|
| 36 |
-
| `chen2024_convnext/genimage_sd14_released.pth` | DRCT-ConvNeXt | Hybrid | authors' released checkpoint β SD1.4/1.5 diffusion-reconstruction training | β
released |
|
| 37 |
-
| `chen2024_clip/genimage_sd14_released.pth` | DRCT-CLIP | Hybrid | authors' released checkpoint β SD1.4/1.5 diffusion-reconstruction training | β
released |
|
| 38 |
-
| `aide/genimage_sd14_released.pth` | AIDE | Hybrid | authors' released checkpoint, trained on official SD1.4 split | β
released |
|
| 39 |
-
| `effort/genimage_sd14_released.pth` | Effort | Transformer/VLM | authors' released checkpoint (`effort_clip_L14_trainOn_sdv14.pth`), trained on official SD1.4 split | β
released |
|
| 40 |
-
| `c2pclip/genimage_sd14_released.pth` | C2P-CLIP | Transformer/VLM | authors' released checkpoint, GenImage/SD1.4 variant (not the ProGAN one) | β
released |
|
| 41 |
-
| `rajan2025/genimage_sd14_released.pth` | AlignedForensics | Spatial | authors' released "Stay-Positive" checkpoint, SD1.4/LDM-reconstruction training | β
released |
|
| 42 |
-
|
| 43 |
-
**All 13 detector families in the panel are now final.** 8 were retrained by us
|
| 44 |
-
on the official GenImage SD1.4 split (wang2020, corvi2023, npr2024, cavia2024,
|
| 45 |
-
freqnet, spai, ojha2023, d3); 5 are the original authors' own SD1.4-trained
|
| 46 |
-
checkpoints, kept as released (aide, effort, c2pclip, rajan2025, DRCT). Only
|
| 47 |
-
**SPAI** and **DΒ³** required a fresh retrain to join the panel despite already
|
| 48 |
-
having released checkpoints β SPAI's original paper trains its classifier head
|
| 49 |
-
on a different (non-SD1.4) latent-diffusion corpus, with SD1.4/SD1.3 used solely
|
| 50 |
-
as held-out zero-shot test generators in their own Table 1; DΒ³'s released
|
| 51 |
-
checkpoint trains on a broader merged UFD+GenImage pool rather than SD1.4 alone.
|
| 52 |
|
| 53 |
## Checkpoint format
|
| 54 |
|
|
@@ -62,11 +25,3 @@ threshold = ckpt["threshold"] # Youden-J calibrated decision threshold (retrai
|
|
| 62 |
All detectors output a single fake-logit; `sigmoid(logit) >= threshold` β "AI-generated".
|
| 63 |
Architecture definitions live in each detector's original repository; the GUARD
|
| 64 |
codebase vendors and wires them for evaluation.
|
| 65 |
-
|
| 66 |
-
## Why SD1.4?
|
| 67 |
-
|
| 68 |
-
GenImage (Zhu et al., NeurIPS 2023) identifies SD v1.4 as the training generator
|
| 69 |
-
with the best cross-generator transfer, and the majority of GenImage-family released
|
| 70 |
-
checkpoints (AIDE, Effort, C2P-CLIP, DΒ³, DRCT, AlignedForensics) are already trained
|
| 71 |
-
on SD1.4 data. Anchoring the retrained panel on the same split makes the detection
|
| 72 |
-
*method* β not its training *data* β the object of comparison.
|
|
|
|
| 9 |
library_name: pytorch
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# GUARD-AI Checkpoints
|
| 13 |
|
| 14 |
+
Checkpoints used in the **GUARD-AI** benchmark.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## Checkpoint format
|
| 17 |
|
|
|
|
| 25 |
All detectors output a single fake-logit; `sigmoid(logit) >= threshold` β "AI-generated".
|
| 26 |
Architecture definitions live in each detector's original repository; the GUARD
|
| 27 |
codebase vendors and wires them for evaluation.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|