File size: 3,717 Bytes
51d4069 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 | # Motorcycle Brand Classification App
This app compares 3 image classification approaches on motorcycle images:
- Fine-tuned ViT model [`durovali/vit-motorcycle`](https://huggingface.co/durovali/vit-motorcycle)
- Zero-shot CLIP (`openai/clip-vit-large-patch14`)
- OpenAI vision model (GPT-4.1 Vision)
## Dataset Description
- Custom dataset created manually from web images (Google Images, Unsplash, Pexels)
- Number of classes: `6` (bmw, honda, kawasaki, suzuki, triumph, yamaha)
- Total images: `55` (~9 images per class)
- Split: 80% train (44 images) / 20% validation (11 images)
- Image formats: mixed JPG and PNG
- Dataset loaded using HuggingFace `imagefolder` builder
## Preprocessing Steps
- Images loaded via HuggingFace `imagefolder` dataset builder
- Converted to RGB format
- **Training transforms:** RandomResizedCrop (224px), RandomHorizontalFlip, ToTensor, Normalize
- **Validation transforms:** Resize (224px), CenterCrop (224px), ToTensor, Normalize
- Normalized with ImageNet mean and std values from ViT processor
## Model and Evaluation
- Base model: `google/vit-base-patch16-224-in21k` (Vision Transformer)
- Fine-tuned with transfer learning on custom motorcycle dataset
- Training: 10 epochs, learning rate 2e-5, batch size 16, fp16 on GPU (Tesla T4)
- Hugging Face model: [https://huggingface.co/durovali/vit-motorcycle](https://huggingface.co/durovali/vit-motorcycle)
## Training Performance
| Training Loss | Epoch | Validation Loss | Accuracy |
|---:|---:|---:|---:|
| 1.8418 | 1 | 1.7780 | 0.1818 |
| 1.7629 | 2 | 1.7664 | 0.4545 |
| 1.7311 | 3 | 1.7577 | 0.3636 |
| 1.7177 | 5 | 1.7402 | 0.4545 |
| 1.6922 | 10 | 1.7145 | 0.4545 |
## Example Image Results
The table below reports the true class and Top-3 predictions for ViT and CLIP.
| Image | True Class | ViT Top-3 (score) | CLIP Top-3 (score) | OpenAI (label, confidence) |
|---|---|---|---|---|
| `bmw.jpg` | `bmw` | `honda` (0.2178)<br>`kawasaki` (0.1764)<br>`suzuki` (0.1591) | `bmw` (0.9804)<br>`yamaha` (0.0165)<br>`triumph` (0.0019) | `bmw` (0.95) |
| `honda.jpg` | `honda` | `honda` (0.2035)<br>`kawasaki` (0.1863)<br>`yamaha` (0.1599) | `honda` (0.4927)<br>`yamaha` (0.4869)<br>`suzuki` (0.0100) | `honda` (0.95) |
| `kawasaki.jpg` | `kawasaki` | `kawasaki` (0.2186)<br>`honda` (0.2039)<br>`bmw` (0.1713) | `yamaha` (0.7077)<br>`kawasaki` (0.1124)<br>`bmw` (0.0653) | `kawasaki` (0.95) |
| `triumph.jpg` | `triumph` | `honda` (0.2249)<br>`bmw` (0.1748)<br>`kawasaki` (0.1738) | `triumph` (0.9904)<br>`bmw` (0.0071)<br>`yamaha` (0.0017) | `triumph` (0.98) |
| `yamaha.jpg` | `yamaha` | `honda` (0.1947)<br>`yamaha` (0.1914)<br>`kawasaki` (0.1635) | `yamaha` (0.9057)<br>`bmw` (0.0354)<br>`honda` (0.0213) | `yamaha` (0.90) |
## Comparison Results
| Model | Type | Correct Predictions | Accuracy | Notes |
|---|---|---|---|---|
| ViT (fine-tuned) | Closed-set | 1/5 (kawasaki) | 20% | Too few training images (~9 per class) |
| CLIP | Zero-shot (Open-Source) | 4/5 | 80% | Very strong without any training! |
| OpenAI GPT-4.1 | Zero-shot (Closed-Source) | 5/5 | 100% | Perfect – recognizes logos and design details |
**Key finding:** The fine-tuned ViT model underperforms due to the very small dataset size (~ 55 images total). CLIP and OpenAI perform much better as zero-shot models because they were pre-trained on massive datasets. With more training data (~ 500+ images per class), the fine-tuned model would likely outperform zero-shot approaches.
## Links
- Model: [https://huggingface.co/durovali/vit-motorcycle](https://huggingface.co/durovali/vit-motorcycle)
- App: [https://huggingface.co/spaces/durovali/motorcycle-classification](https://huggingface.co/spaces/durovali/motorcycle-classification) |