litert-community/swin_base_patch4_window7_224.ms_in1k

Swin Base Patch4 Window7 224

This repository contains LiteRT/TFLite exports of the TIMM image-classification model swin_base_patch4_window7_224.ms_in1k.

Model Description

The model files were converted from pretrained TIMM weights published at timm/swin_base_patch4_window7_224.ms_in1k.

Available Model Files

File	Description	Quantization
swin_base_patch4_window7_224_fp32.tflite	Floating-point LiteRT/TFLite model.	Floating-point weights and activations.
swin_base_patch4_window7_224_dynamic_wi8_afp32.tflite	Dynamic weight-quantized LiteRT/TFLite model.	INT8 weights with floating-point activations.
swin_base_patch4_window7_224_int8_channelwise.tflite	Static INT8 LiteRT/TFLite model.	INT8 weights and INT8 activations, with channelwise weight quantization.

Quantization Schema

swin_base_patch4_window7_224_int8_channelwise.tflite was quantized with AI Edge Quantizer's static W8A8 recipe (STATIC_WI8_AI8).

The schema is:

Tensor group	Quantization
Weights	INT8, symmetric, channelwise quantization.
Activations	INT8, asymmetric, tensorwise quantization.
Model input	INT8, tensorwise quantized NCHW image tensor with shape [1, 3, 224, 224].
Model output	INT8, tensorwise quantized logits tensor with shape [1, 1000].

Calibration used real ImageNet validation images with the TIMM preprocessing flow for swin_base_patch4_window7_224.ms_in1k. The resolved TIMM preprocessing config was {"crop_mode": "center", "crop_pct": 0.9, "input_size": [3, 224, 224], "interpolation": "bicubic", "mean": [0.485, 0.456, 0.406], "std": [0.229, 0.224, 0.225]}. When using APIs that expose raw tensor buffers, prepare the input and output using the quantization parameters stored in the model.

Runtime Compatibility

These artifacts are intended for LiteRT CPU and GPU execution.

Enablement for other NPU backends is still under validation.

Intended Uses & Limitations

The model files were converted from pretrained weights from TIMM. The models may have their own licenses or terms and conditions derived from TIMM and the dataset used for training. It is your responsibility to determine whether you have permission to use the models for your use case.

Model Details

• Model Type: Image classification / feature backbone
• Model Stats:
  • Params (M): 87.8
  • GMACs: 15.5
  • Activations (M): 36.6
  • Image size: 224 x 224
• Papers:
  • Swin Transformer: Hierarchical Vision Transformer using Shifted Windows: https://arxiv.org/abs/2103.14030
• Original: https://github.com/microsoft/Swin-Transformer
• Dataset: ImageNet-1k

Citation

@inproceedings{liu2021Swin,
  title={Swin Transformer: Hierarchical Vision Transformer using Shifted Windows},
  author={Liu, Ze and Lin, Yutong and Cao, Yue and Hu, Han and Wei, Yixuan and Zhang, Zheng and Lin, Stephen and Guo, Baining},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
  year={2021}
}

@misc{rw2019timm,
  author = {Ross Wightman},
  title = {PyTorch Image Models},
  year = {2019},
  publisher = {GitHub},
  journal = {GitHub repository},
  doi = {10.5281/zenodo.4414861},
  howpublished = {\url{https://github.com/huggingface/pytorch-image-models}}
}