README.md

---
license: apache-2.0
base_model:
- google/siglip2-base-patch16-224
library_name: transformers
tags:
- SigLIP2
- ImageShield
- 90M
- Guardrail
language:
- en
pipeline_tag: image-classification
datasets:
- prithivMLmods/ImageShield-Guardrail-80K
- prithivMLmods/ImageShield-Guardrail-Realism-60K
---

![1](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/PxMC3xQE3LdbpfWzv4MBD.png)

# **ImageShield-SUPER-90M**

> **ImageShield-SUPER-90M** is a vision-language image classification model based on **google/siglip2-base-patch16-224**, trained on **100K samples from the ImageShield-Guardrail Safe and Unsafe Images dataset**. Built on the **SiglipForImageClassification** architecture, the model is designed to classify visual content as **Safe** or **Unsafe** for content moderation and media filtering.

> [!IMPORTANT]
> This model is experimental. Expert multimodal models are available here: [ImageShield Multimodal SFT Collection](https://huggingface.co/collections/prithivMLmods/imageshield-multimodal-sft).

> [!note]
> *SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features*
> [https://arxiv.org/pdf/2502.14786](https://arxiv.org/pdf/2502.14786)

## **Label Space: 2 Classes**

The model classifies each image into one of the following content categories:

```text
Class 0: "Safe"
Class 1: "Unsafe"
```

## **Install Dependencies**

```bash
pip install transformers torch torchvision pillow gradio
```

## **Inference Code**

```python
import gradio as gr
from transformers import AutoImageProcessor, SiglipForImageClassification
from PIL import Image
import torch

# Load model and processor
model_name = "prithivMLmods/ImageShield-SUPER-90M"
model = SiglipForImageClassification.from_pretrained(model_name)
processor = AutoImageProcessor.from_pretrained(model_name)

# ID to Label mapping
id2label = {
    "0": "Safe",
    "1": "Unsafe"
}

def classify_image(image):
    image = Image.fromarray(image).convert("RGB")
    inputs = processor(images=image, return_tensors="pt")

    with torch.no_grad():
        outputs = model(**inputs)
        logits = outputs.logits
        probs = torch.nn.functional.softmax(logits, dim=1).squeeze().tolist()

    prediction = {
        id2label[str(i)]: round(probs[i], 3)
        for i in range(len(probs))
    }

    return prediction

# Gradio Interface
iface = gr.Interface(
    fn=classify_image,
    inputs=gr.Image(type="numpy"),
    outputs=gr.Label(
        num_top_classes=2,
        label="Predicted Content Type"
    ),
    title="ImageShield-SUPER-90M",
    description="Classifies images as Safe or Unsafe."
)

if __name__ == "__main__":
    iface.launch()
```

## **Intended Use**

This model is intended for applications such as:

* **Content Moderation:** Identify unsafe visual content.
* **Parental Controls:** Support AI-based media filtering.
* **Dataset Preprocessing:** Categorize and filter safe and unsafe images.
* **Online Platforms:** Assist with content safety and upload moderation.
* **AI Image Applications:** Provide an additional safety layer for image generation and editing workflows.

## **Classification Report**

### Training vs Evaluation Loss / Accuracy

![Training vs Evaluation Loss and Accuracy](assets/training_eval_graph.png)

### Precision / Recall / F1-score per Class

![Per-Class Precision, Recall, and F1-score](assets/classification_report_bar.png)

### Confusion Matrix

![Confusion Matrix](assets/confusion_matrix.png)

### Test Set Class Distribution

![Test Set Class Distribution](assets/class_distribution_pie.png)

### Overall Prediction Accuracy

![Overall Prediction Accuracy](assets/prediction_accuracy_pie.png)

### Misalignment Distribution by True Class

![Misalignment Distribution by True Class](assets/misalignment_distribution_pie.png)

## **Acknowledgements**

* **[Transformers](https://huggingface.co/docs/transformers/en/index)**: Transformers provides state-of-the-art machine learning models for text, computer vision, audio, video, and multimodal tasks, supporting both inference and training.

* **[SigLIP 2](https://huggingface.co/papers/2502.14786)**: Multilingual vision-language encoders with improved semantic understanding, localization, and dense feature representations.