HanClinto commited on
Commit
c1b245a
·
verified ·
1 Parent(s): 9280009

Align Cornelius comparison with fastweb-single

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -23,6 +23,7 @@ MobileViT-XXS corner detector trained to locate the four corners of a CCG card
23
  | Outputs | corners (8 floats, normalised [0,1]), compatibility presence logit, sharpness scalar |
24
  | Parameters | ~1.06M |
25
  | File size | 4.2 MB (fp32 ONNX, simplified) |
 
26
  | Codename | cornelius |
27
  | Latest version | 2.12 |
28
 
@@ -48,6 +49,36 @@ degenerate predictions where two predicted corners nearly coincide.
48
  | 1.221 | MobileViT-XXS + independent SimCC | ~1.82M | 7.1 MB | — | 0.933910 / 0.928732 | 138 / 91 | Strong normal detector, but vulnerable to rotation-induced corner collapse. |
49
  | 1.210 | MobileViT-XXS + independent SimCC | ~1.82M | 7.1 MB | 0.8857 combined | — | — | Earlier beta; reported combined held-out IoU 0.8857. |
50
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
51
  ### Cornelius 2.12 checkpoint selection
52
 
53
  The 2.12 release was selected from a low-LR continuation because it best balanced
 
23
  | Outputs | corners (8 floats, normalised [0,1]), compatibility presence logit, sharpness scalar |
24
  | Parameters | ~1.06M |
25
  | File size | 4.2 MB (fp32 ONNX, simplified) |
26
+ | Local CPU speed | 23.2 ms / frame, 43.0 FPS (ONNX Runtime CPU, single thread, 384×384) |
27
  | Codename | cornelius |
28
  | Latest version | 2.12 |
29
 
 
49
  | 1.221 | MobileViT-XXS + independent SimCC | ~1.82M | 7.1 MB | — | 0.933910 / 0.928732 | 138 / 91 | Strong normal detector, but vulnerable to rotation-induced corner collapse. |
50
  | 1.210 | MobileViT-XXS + independent SimCC | ~1.82M | 7.1 MB | 0.8857 combined | — | — | Earlier beta; reported combined held-out IoU 0.8857. |
51
 
52
+ ### Cornelius vs fastweb-single
53
+
54
+ Cornelius remains the stable, conservative default. The `fastweb-single` testing
55
+ model is a smaller EfficientViT-B0 global-token SimCC detector that is being
56
+ evaluated as a faster replacement candidate. Both models use the same 384×384
57
+ input contract and produce `corners`, compatibility `presence`, and `sharpness`
58
+ outputs.
59
+
60
+ | Model | Channel | Normal test IoU | Normal collapse | Full ±50° mean / p10 IoU | Full-rotation bad / collapse | ONNX size | Params | Local CPU speed |
61
+ |---|---|---:|---:|---:|---:|---:|---:|---:|
62
+ | Cornelius 2.12 | stable | **0.968911** | 18 | 0.970411 / 0.954621 | **0 / 0** | 4.41 MB | 1.05M | 23.2 ms / 43.0 FPS |
63
+ | fastweb-single 1.39 | testing | 0.968839 | **13** | **0.974255 / 0.960757** | 1 / 0 | **3.19 MB** | **0.77M** | **8.4 ms / 119.4 FPS** |
64
+
65
+ Takeaways:
66
+
67
+ - Normal accuracy is effectively tied: fastweb-single trails Cornelius by
68
+ 0.000072 IoU on the normal held-out test.
69
+ - fastweb-single is about 28% smaller on disk and about 2.8× faster in the
70
+ local single-thread CPU benchmark.
71
+ - fastweb-single has stronger rotation-stress mean and p10 IoU, but still has
72
+ one remaining bad rotation-stress case where Cornelius has zero.
73
+ - The current published fastweb-single ONNX uses the same argmax SimCC decoding
74
+ style; small post-hoc parabolic peak-refinement gains were observed in local
75
+ experiments but are not baked into this artifact.
76
+
77
+ Speed benchmark details: ONNX Runtime 1.24.4, CPUExecutionProvider,
78
+ `intra_op_num_threads=1`, `inter_op_num_threads=1`, 50 warmup runs and 300 timed
79
+ runs on a 384×384 float32 input. These numbers are intended for model-to-model
80
+ comparison on the same machine, not as universal device benchmarks.
81
+
82
  ### Cornelius 2.12 checkpoint selection
83
 
84
  The 2.12 release was selected from a low-LR continuation because it best balanced