Schmidtphilipp's picture
Upload 2 files
d437264 verified
|
Raw
History Blame Contribute Delete
814 Bytes
metadata
license: apache-2.0
tags:
  - adafactor
  - approx-gelu
  - batchnorm
  - classification
  - exponential
  - mobilevit
  - standard
  - tensor-fusion
  - tiny
  - xavier

model_339521087_mobilevit_tiny.py

Model Overview

A tiny-scale implementation of the mobilevit architecture, built for classification tasks.

Architecture

  • Architecture: mobilevit
  • Scale: tiny
  • Attention: standard
  • Fusion strategy: tensor fusion
  • Task head: classification
  • Activation: approx gelu
  • Normalization: batchnorm
  • Initialization: xavier

Training

  • Optimizer: adafactor
  • LR scheduler: exponential

Files

  • model_339521087_mobilevit_tiny.py — main artifact of this repository

License

See the license field above.