---
pipeline_tag: image-feature-extraction
license: apache-2.0
base_model: facebook/dino-vitb8
library_name: kerasformers
tags:
- keras
- kerasformers
- dino
- feature-extraction
- vision
- arxiv:2104.14294
- pytorch
- jax
- tf
---

## ***See [our collection](https://huggingface.co/collections/kerasformers/dino-v1-v2-v3-6a6a94f8281a2f373f70e769) for all versions of DINO.***

# Run DINO with Keras 3: JAX, PyTorch, or TensorFlow

[![GitHub](https://img.shields.io/badge/GitHub-KerasFormers-black?logo=github)](https://github.com/IMvision12/KerasFormers) [![Docs](https://img.shields.io/badge/Docs-DINO-blue)](https://imvision12.github.io/KerasFormers/dino/) [![Collection](https://img.shields.io/badge/HF-DINO%20collection-yellow)](https://huggingface.co/collections/kerasformers/dino-v1-v2-v3-6a6a94f8281a2f373f70e769)

# kerasformers/dino-vitb8

Paper: [Emerging Properties in Self-Supervised Vision Transformers (arXiv:2104.14294)](https://arxiv.org/abs/2104.14294) · [HF Papers](https://huggingface.co/papers/2104.14294)

DINO is self-supervised: a student and teacher match across crops of the same image with no labels. The resulting features are semantic for free. These checkpoints are backbones that return tokens / feature maps.

For more details on the model, please go to the upstream [model card](https://huggingface.co/facebook/dino-vitb8).

Pure-**Keras 3** conversion of [`facebook/dino-vitb8`](https://huggingface.co/facebook/dino-vitb8) for [kerasformers](https://github.com/IMvision12/KerasFormers). One implementation runs unmodified on **TensorFlow / Torch / JAX**.

This is a **self-supervised backbone** (`DinoViTModel`), not a task head.

## ✨ Quick start

```python
import os
os.environ["KERAS_BACKEND"] = "torch"  # or "jax" / "tensorflow"

from kerasformers.models.dino import DinoViTModel, DinoImageProcessor

# The processor resizes + ImageNet-normalizes, so build the model with
# include_normalization=False (it would otherwise normalize a second time).
model = DinoViTModel.from_weights(
    "kerasformers/dino-vitb8", include_normalization=False
)
processor = DinoImageProcessor.from_weights("kerasformers/dino-vitb8")

pixel_values = processor("your_image.jpg")["pixel_values"]
features = model(pixel_values, training=False)
print(pixel_values.shape, features.shape)
```

Load any DINO variant the same way with `from_weights("kerasformers/<variant>")`:

| Variant | Hub | Backbone |
|---|---|---|
| `dino-vits16` | [`kerasformers/dino-vits16`](https://huggingface.co/kerasformers/dino-vits16) | ViT-S/16 |
| `dino-vits8` | [`kerasformers/dino-vits8`](https://huggingface.co/kerasformers/dino-vits8) | ViT-S/8 |
| `dino-vitb16` | [`kerasformers/dino-vitb16`](https://huggingface.co/kerasformers/dino-vitb16) | ViT-B/16 |
| `dino-vitb8` | [`kerasformers/dino-vitb8`](https://huggingface.co/kerasformers/dino-vitb8) | ViT-B/8 |
| `dino-resnet50` | [`kerasformers/dino-resnet50`](https://huggingface.co/kerasformers/dino-resnet50) | ResNet-50 |

## Tips

- Set `KERAS_BACKEND` **before** importing Keras / kerasformers.
- The processor normalizes; pair it with `include_normalization=False`. To skip it, feed raw `[0, 255]` pixels and keep the default `include_normalization=True`.
- `dino-resnet50` was converted from torch.hub `facebookresearch/dino`.
- See [DINO docs](https://imvision12.github.io/KerasFormers/dino/) and [Loading Weights](https://imvision12.github.io/KerasFormers/loading_weights/).
- Community / upstream weights: `DinoViTModel.from_weights("hf:facebook/dino-vitb8")`.

## Special Thanks

A huge thank you to the Facebook AI Research DINO authors for creating and releasing these models.

License: Apache 2.0.