Create readme.md

readme.md

@@ -0,0 +1,67 @@
+# Motorcycle Brand Classification App
+
+This app compares 3 image classification approaches on motorcycle images:
+
+- Fine-tuned ViT model [`durovali/vit-motorcycle`](https://huggingface.co/durovali/vit-motorcycle)
+- Zero-shot CLIP (`openai/clip-vit-large-patch14`)
+- OpenAI vision model (GPT-4.1 Vision)
+
+## Dataset Description
+
+- Custom dataset created manually from web images (Google Images, Unsplash, Pexels)
+- Number of classes: `6` (bmw, honda, kawasaki, suzuki, triumph, yamaha)
+- Total images: `55` (~9 images per class)
+- Split: 80% train (44 images) / 20% validation (11 images)
+- Image formats: mixed JPG and PNG
+- Dataset loaded using HuggingFace `imagefolder` builder
+
+## Preprocessing Steps
+
+- Images loaded via HuggingFace `imagefolder` dataset builder
+- Converted to RGB format
+- **Training transforms:** RandomResizedCrop (224px), RandomHorizontalFlip, ToTensor, Normalize
+- **Validation transforms:** Resize (224px), CenterCrop (224px), ToTensor, Normalize
+- Normalized with ImageNet mean and std values from ViT processor
+
+## Model and Evaluation
+
+- Base model: `google/vit-base-patch16-224-in21k` (Vision Transformer)
+- Fine-tuned with transfer learning on custom motorcycle dataset
+- Training: 10 epochs, learning rate 2e-5, batch size 16, fp16 on GPU (Tesla T4)
+- Hugging Face model: [https://huggingface.co/durovali/vit-motorcycle](https://huggingface.co/durovali/vit-motorcycle)
+
+## Training Performance
+
+| Training Loss | Epoch | Validation Loss | Accuracy |
+|---:|---:|---:|---:|
+| 1.8418 | 1 | 1.7780 | 0.1818 |
+| 1.7629 | 2 | 1.7664 | 0.4545 |
+| 1.7311 | 3 | 1.7577 | 0.3636 |
+| 1.7177 | 5 | 1.7402 | 0.4545 |
+| 1.6922 | 10 | 1.7145 | 0.4545 |
+
+## Example Image Results
+
+The table below reports the true class and Top-3 predictions for ViT and CLIP.
+
+| Image | True Class | ViT Top-3 (score) | CLIP Top-3 (score) | OpenAI (label, confidence) |
+|---|---|---|---|---|
+| `bmw.jpg` | `bmw` | `honda` (0.2178)<br>`kawasaki` (0.1764)<br>`suzuki` (0.1591) | `bmw` (0.9804)<br>`yamaha` (0.0165)<br>`triumph` (0.0019) | `bmw` (0.95) |
+| `honda.jpg` | `honda` | `honda` (0.2035)<br>`kawasaki` (0.1863)<br>`yamaha` (0.1599) | `honda` (0.4927)<br>`yamaha` (0.4869)<br>`suzuki` (0.0100) | `honda` (0.95) |
+| `kawasaki.jpg` | `kawasaki` | `kawasaki` (0.2186)<br>`honda` (0.2039)<br>`bmw` (0.1713) | `yamaha` (0.7077)<br>`kawasaki` (0.1124)<br>`bmw` (0.0653) | `kawasaki` (0.95) |
+| `triumph.jpg` | `triumph` | `honda` (0.2249)<br>`bmw` (0.1748)<br>`kawasaki` (0.1738) | `triumph` (0.9904)<br>`bmw` (0.0071)<br>`yamaha` (0.0017) | `triumph` (0.98) |
+| `yamaha.jpg` | `yamaha` | `honda` (0.1947)<br>`yamaha` (0.1914)<br>`kawasaki` (0.1635) | `yamaha` (0.9057)<br>`bmw` (0.0354)<br>`honda` (0.0213) | `yamaha` (0.90) |
+
+## Comparison Results
+
+| Model | Type | Correct Predictions | Accuracy | Notes |
+|---|---|---|---|---|
+| ViT (fine-tuned) | Closed-set | 1/5 (kawasaki) | 20% | Too few training images (~9 per class) |
+| CLIP | Zero-shot (Open-Source) | 4/5 | 80% | Very strong without any training! |
+| OpenAI GPT-4.1 | Zero-shot (Closed-Source) | 5/5 | 100% | Perfect – recognizes logos and design details |
+
+**Key finding:** The fine-tuned ViT model underperforms due to the very small dataset size (~ 55 images total). CLIP and OpenAI perform much better as zero-shot models because they were pre-trained on massive datasets. With more training data (~ 500+ images per class), the fine-tuned model would likely outperform zero-shot approaches.
+## Links
+
+- Model: [https://huggingface.co/durovali/vit-motorcycle](https://huggingface.co/durovali/vit-motorcycle)
+- App: [https://huggingface.co/spaces/durovali/motorcycle-classification](https://huggingface.co/spaces/durovali/motorcycle-classification)