|
|
--- |
|
|
library_name: transformers |
|
|
license: wtfpl |
|
|
datasets: |
|
|
- fashion_mnist |
|
|
tags: |
|
|
- moe |
|
|
--- |
|
|
|
|
|
# Model Card for ViTMix-v1 |
|
|
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
|
|
This model is a poorly functional demo to using MOEs in computer vision |
|
|
|
|
|
## Model Details |
|
|
|
|
|
### Model Description |
|
|
|
|
|
This Model is mean't to serve more as a blueprint than a base. It has been trained of fashionmnist to prove that I can do tensor maths. It achieves an average loss of 0.4-ish. |
|
|
|
|
|
The code is in files. Do what you want! |