Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,63 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
## 📊 Hybrid Model Results (HMDB51)
|
| 2 |
+
|
| 3 |
+
The hybrid model (TimeSformer + RetNet) was also trained on the **HMDB51 dataset**.
|
| 4 |
+
|
| 5 |
+
Due to Kaggle’s runtime limitation, training was interrupted at **Epoch 12**, so results are reported up to **Epoch 11**. Training will be resumed in a later stage.
|
| 6 |
+
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
### 🔹 Training Results (Epoch 1–11)
|
| 10 |
+
|
| 11 |
+
| Epoch | Train Loss | Train Acc | Val Loss | Val Acc | F1 |
|
| 12 |
+
|------|------------|-----------|----------|---------|-----|
|
| 13 |
+
| 1 | 3.9312 | 0.0350 | 3.8099 | 0.0967 | 0.0855 |
|
| 14 |
+
| 2 | 3.6330 | 0.1791 | 3.2948 | 0.3654 | 0.3149 |
|
| 15 |
+
| 3 | 3.0989 | 0.3691 | 2.6927 | 0.5150 | 0.4579 |
|
| 16 |
+
| 4 | 2.6278 | 0.5048 | 2.2879 | 0.5869 | 0.5503 |
|
| 17 |
+
| 5 | 2.3198 | 0.5782 | 2.0438 | 0.6255 | 0.5961 |
|
| 18 |
+
| 6 | 2.1387 | 0.6194 | 1.9152 | 0.6242 | 0.6074 |
|
| 19 |
+
| 7 | 1.9876 | 0.6657 | 1.8369 | 0.6418 | 0.6308 |
|
| 20 |
+
| 8 | 1.9140 | 0.6936 | 1.7966 | 0.6359 | 0.6188 |
|
| 21 |
+
| 9 | 1.8539 | 0.7041 | 1.7619 | 0.6556 | 0.6426 |
|
| 22 |
+
| 10 | 1.8149 | 0.7244 | 1.7523 | **0.6614** | **0.6512** |
|
| 23 |
+
| 11 | 1.7270 | 0.7561 | 1.7543 | 0.6556 | 0.6472 |
|
| 24 |
+
|
| 25 |
+
---
|
| 26 |
+
|
| 27 |
+
## 🏆 Best Performance (Current)
|
| 28 |
+
|
| 29 |
+
- **Validation Accuracy:** **66.14%**
|
| 30 |
+
- **F1 Score:** 0.6512
|
| 31 |
+
- Achieved at **Epoch 10**
|
| 32 |
+
|
| 33 |
+
---
|
| 34 |
+
|
| 35 |
+
## ⚠️ Training Status
|
| 36 |
+
|
| 37 |
+
- Training **interrupted at Epoch 12** due to runtime limit
|
| 38 |
+
- Model will be **resumed from best checkpoint**
|
| 39 |
+
- Final performance may improve after full training
|
| 40 |
+
|
| 41 |
+
---
|
| 42 |
+
|
| 43 |
+
## ⚡ Efficiency
|
| 44 |
+
|
| 45 |
+
- Peak GPU Memory: **~7.2 GB**
|
| 46 |
+
- ~25% lower than standard TimeSformer
|
| 47 |
+
- Faster training per epoch
|
| 48 |
+
|
| 49 |
+
---
|
| 50 |
+
|
| 51 |
+
## 📌 Observations
|
| 52 |
+
|
| 53 |
+
- Steady improvement until Epoch 10
|
| 54 |
+
- Slight plateau after that (possible early convergence)
|
| 55 |
+
- Lower accuracy compared to UCF101 (expected due to dataset complexity)
|
| 56 |
+
|
| 57 |
+
---
|
| 58 |
+
|
| 59 |
+
## 🔄 Next Steps
|
| 60 |
+
|
| 61 |
+
- Resume training from Epoch 11 checkpoint
|
| 62 |
+
- Complete remaining epochs
|
| 63 |
+
- Compare final performance with baseline model
|