Improve model card for AFOG: Adversarial Attention Perturbations for Large Object Detection Transformers

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +20 -5
README.md CHANGED
@@ -1,8 +1,23 @@
1
- ## detrex: Benchmarking Detection Transformers
 
 
 
 
2
 
3
- This is the huggingface space for IDEA-CVR proposed DETR-based research platform `detrex`
4
 
5
- - detrex github link: https://github.com/IDEA-Research/detrex
6
- - detrex documentation: https://detrex.readthedocs.io/en/latest/
7
 
8
- We will store our detrex pretrained checkpoints both in github and huggingface space.
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: object-detection
4
+ library_name: transformers
5
+ ---
6
 
7
+ # Adversarial Attention Perturbations for Large Object Detection Transformers (AFOG)
8
 
9
+ This repository hosts the implementation for the paper [Adversarial Attention Perturbations for Large Object Detection Transformers](https://huggingface.co/papers/2508.02987).
 
10
 
11
+ **AFOG** (Attention-Focused Offensive Gradient) is a novel adversarial perturbation method designed to attack both large transformer-based object detectors and conventional CNN-based detectors with a unified adversarial attention framework. It leverages a learnable attention mechanism to focus perturbations on vulnerable image regions, significantly increasing attack performance while maintaining visual imperceptibility.
12
+
13
+ <div align="center">
14
+ <img src="https://github.com/IDEA-Research/AFOG/raw/main/assets/examples.png" width="100%" height="100%"/>
15
+ </div>
16
+
17
+ ## Key Features
18
+ * **Unified Attack Framework**: Effective against both transformer-based and CNN-based object detectors.
19
+ * **Attention-Focused Perturbations**: Utilizes a learnable attention mechanism to target vulnerable image regions, improving attack efficacy.
20
+ * **Efficient and Stealthy**: Generates strategically designed, visually imperceptible perturbations that cause well-trained models to fail.
21
+
22
+ ## Installation and Usage
23
+ For detailed installation instructions, environment setup, and comprehensive usage examples (including Jupyter notebooks for single-image attacks and Slurm scripts for COCO evaluation), please refer to the official [AFOG GitHub repository](https://github.com/IDEA-Research/detrex).