AnilShah's picture
Upload 2 files
b86d7bb verified
|
Raw
History Blame Contribute Delete
795 Bytes
metadata
license: cc-by-4.0
tags:
  - batchnorm
  - classification
  - kaiming-normal
  - linear
  - low-rank
  - mobilevit
  - novograd
  - onecycle
  - swish
  - tiny

model_340169584_mobilevit_tiny.py

Model Overview

A tiny-scale implementation of the mobilevit architecture, built for classification tasks.

Architecture

  • Architecture: mobilevit
  • Scale: tiny
  • Attention: linear
  • Fusion strategy: low rank
  • Task head: classification
  • Activation: swish
  • Normalization: batchnorm
  • Initialization: kaiming normal

Training

  • Optimizer: novograd
  • LR scheduler: onecycle

Files

  • model_340169584_mobilevit_tiny.py — main artifact of this repository

License

See the license field above.