---
library_name: litert
base_model: timm/deit_small_patch16_224.fb_in1k
tags:
  - vision
  - image-classification
datasets:
  - imagenet-1k
---
# deit_small_patch16_224

Converted TIMM image classification model for LiteRT.

- Source architecture: `deit_small_patch16_224`
- Source checkpoint: `timm/deit_small_patch16_224.fb_in1k`
- File: `model.tflite`
- Input: `float32` tensor in NCHW layout, shape `[1, 3, 224, 224]`
- Output: ImageNet-1K logits, shape `[1, 1000]`

## Runtime Status

- CPU smoke test: passed with LiteRT `CompiledModel`.
- GPU delegation: currently blocked for this model by rank-5 tensor patterns in the GPU backend, mostly `RESHAPE`, `TRANSPOSE`, and related window/attention operations. The model is published as CPU-ready while GPU support is being improved.

## Model Details

- **Model Type:** Image classification / feature backbone
- **Model Stats:**
  - Params (M): 22.1
  - GMACs: 4.6
  - Activations (M): 11.9
  - Image size: 224 x 224
- **Papers:**
  - Training data-efficient image transformers & distillation through attention: https://arxiv.org/abs/2012.12877
- **Original:** https://github.com/facebookresearch/deit
- **Dataset:** ImageNet-1k

## Citation

```bibtex
@InProceedings{pmlr-v139-touvron21a,
  title =     {Training data-efficient image transformers & distillation through attention},
  author =    {Touvron, Hugo and Cord, Matthieu and Douze, Matthijs and Massa, Francisco and Sablayrolles, Alexandre and Jegou, Herve},
  booktitle = {International Conference on Machine Learning},
  pages =     {10347--10357},
  year =      {2021},
  volume =    {139},
  month =     {July}
}
```
```bibtex
@misc{rw2019timm,
  author = {Ross Wightman},
  title = {PyTorch Image Models},
  year = {2019},
  publisher = {GitHub},
  journal = {GitHub repository},
  doi = {10.5281/zenodo.4414861},
  howpublished = {\url{https://github.com/huggingface/pytorch-image-models}}
}
```