nielsr HF Staff commited on
Commit
0ae3241
·
verified ·
1 Parent(s): b7b32ad

Improve model card for AFOG: Adversarial Attention Perturbations for Large Object Detection Transformers

Browse files

This PR updates the model card to document the "Adversarial Attention Perturbations for Large Object Detection Transformers (AFOG)" model.

Changes include:

* Adding the paper title and link.
* Including a summary of the model and its contributions.
* Adding relevant metadata tags: `pipeline_tag: object-detection` and `license: apache-2.0`.
* Providing a link to the official GitHub repository for detailed code and usage.

Files changed (1) hide show
  1. README.md +20 -5
README.md CHANGED
@@ -1,8 +1,23 @@
1
- ## detrex: Benchmarking Detection Transformers
 
 
 
 
2
 
3
- This is the huggingface space for IDEA-CVR proposed DETR-based research platform `detrex`
4
 
5
- - detrex github link: https://github.com/IDEA-Research/detrex
6
- - detrex documentation: https://detrex.readthedocs.io/en/latest/
7
 
8
- We will store our detrex pretrained checkpoints both in github and huggingface space.
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: object-detection
4
+ library_name: transformers
5
+ ---
6
 
7
+ # Adversarial Attention Perturbations for Large Object Detection Transformers (AFOG)
8
 
9
+ This repository hosts the implementation for the paper [Adversarial Attention Perturbations for Large Object Detection Transformers](https://huggingface.co/papers/2508.02987).
 
10
 
11
+ **AFOG** (Attention-Focused Offensive Gradient) is a novel adversarial perturbation method designed to attack both large transformer-based object detectors and conventional CNN-based detectors with a unified adversarial attention framework. It leverages a learnable attention mechanism to focus perturbations on vulnerable image regions, significantly increasing attack performance while maintaining visual imperceptibility.
12
+
13
+ <div align="center">
14
+ <img src="https://github.com/IDEA-Research/AFOG/raw/main/assets/examples.png" width="100%" height="100%"/>
15
+ </div>
16
+
17
+ ## Key Features
18
+ * **Unified Attack Framework**: Effective against both transformer-based and CNN-based object detectors.
19
+ * **Attention-Focused Perturbations**: Utilizes a learnable attention mechanism to target vulnerable image regions, improving attack efficacy.
20
+ * **Efficient and Stealthy**: Generates strategically designed, visually imperceptible perturbations that cause well-trained models to fail.
21
+
22
+ ## Installation and Usage
23
+ For detailed installation instructions, environment setup, and comprehensive usage examples (including Jupyter notebooks for single-image attacks and Slurm scripts for COCO evaluation), please refer to the official [AFOG GitHub repository](https://github.com/IDEA-Research/detrex).