Hristijan123 commited on
Commit
e7877a0
·
verified ·
1 Parent(s): 4ff2310

minor changes to readme

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -61,7 +61,8 @@ Final quantitative comparison is reported on the locked Stanford validation spli
61
  | robust_hard | 0.6839 | 0.7778 | 0.6900 | 0.8355 | 0.8600 | 0.9055 |
62
  | robust_occlusion | 0.6317 | 0.7317 | 0.6366 | 0.8048 | 0.8060 | 0.8600 |
63
 
64
- The augmentation-v2 EfficientNet-B3 model improved both clean validation accuracy and robustness compared with the earlier EfficientNet-B3 candidate.
 
65
 
66
  ## Robustness evaluation
67
 
@@ -83,7 +84,7 @@ The main reason is that Stanford Cars and CompCars have a significant domain and
83
  - Stanford Cars is a clean fine-grained benchmark with 196 make/model/year classes.
84
  - CompCars contains different image domains and different make/model taxonomies.
85
  - Exact Stanford Cars ↔ CompCars make/model/year overlap was too small and biased for safe blind merging.
86
- - Make-level external validation on CompCars showed a strong cross-domain performance drop.
87
 
88
  This confirmed that CompCars integration is a domain adaptation problem, not a simple data-merge task.
89
 
@@ -172,6 +173,9 @@ Appropriate uses:
172
  - prototype vehicle inspection workflow
173
  - academic/academy project demonstration
174
 
 
 
 
175
  ## Limitations
176
 
177
  - The final model is trained on Stanford Cars, not on real drone/robot production footage.
 
61
  | robust_hard | 0.6839 | 0.7778 | 0.6900 | 0.8355 | 0.8600 | 0.9055 |
62
  | robust_occlusion | 0.6317 | 0.7317 | 0.6366 | 0.8048 | 0.8060 | 0.8600 |
63
 
64
+ Compared with the earlier EfficientNet-B3 candidate (no augmentation v2), this model improves clean fine accuracy by +1.6 pts (0.770 0.786) and
65
+ robustness substantially — robust_hard +14 pts (0.543 → 0.684) and robust_occlusion +13 pts (0.502 → 0.632). Full comparison: the GitHub experiment report.
66
 
67
  ## Robustness evaluation
68
 
 
84
  - Stanford Cars is a clean fine-grained benchmark with 196 make/model/year classes.
85
  - CompCars contains different image domains and different make/model taxonomies.
86
  - Exact Stanford Cars ↔ CompCars make/model/year overlap was too small and biased for safe blind merging.
87
+ - Make-level external validation on CompCars dropped to ~28% (vs ~0.87 make accuracy in-domain), confirming a large cross-domain shift.
88
 
89
  This confirmed that CompCars integration is a domain adaptation problem, not a simple data-merge task.
90
 
 
173
  - prototype vehicle inspection workflow
174
  - academic/academy project demonstration
175
 
176
+ Data note: weights are trained on the Stanford Cars dataset (research/educational use); the MIT license covers the project code.
177
+ Use of the weights should respect the Stanford Cars dataset terms.
178
+
179
  ## Limitations
180
 
181
  - The final model is trained on Stanford Cars, not on real drone/robot production footage.