itspublu commited on
Commit
b8cb229
·
verified ·
1 Parent(s): cafc462

Qualify development-sheet benchmark

Browse files
Files changed (1) hide show
  1. README.md +10 -4
README.md CHANGED
@@ -22,7 +22,7 @@ model-index:
22
  split: full
23
  metrics:
24
  - type: accuracy
25
- name: Clip accuracy
26
  value: 0.9778
27
  ---
28
 
@@ -31,11 +31,17 @@ model-index:
31
  A 1.5M-parameter MobileNetV3-small classifier for hand/gripper visibility in
32
  robot-training footage. 96px inputs, sized for microcontroller-class deployment.
33
 
 
 
 
 
 
34
  ## Benchmark
35
 
36
- 97.8% clip accuracy on [referee-lab/hands-visible](https://github.com/publu/referee-lab)
37
- (45-clip public benchmark, robot + wildlife domains) — matching gemma3:27b at
38
- 1/18,000th the parameters.
 
39
 
40
  | Model | Params | Accuracy |
41
  |---|---|---|
 
22
  split: full
23
  metrics:
24
  - type: accuracy
25
+ name: Provisional development-sheet clip accuracy
26
  value: 0.9778
27
  ---
28
 
 
31
  A 1.5M-parameter MobileNetV3-small classifier for hand/gripper visibility in
32
  robot-training footage. 96px inputs, sized for microcontroller-class deployment.
33
 
34
+ The published 97.8% result is from a 45-clip, in-domain development sheet that
35
+ was repeatedly consulted during development and has not yet passed the declared
36
+ independent two-grader gate. It is reproducible development evidence, not a
37
+ frozen external benchmark.
38
+
39
  ## Benchmark
40
 
41
+ 97.8% clip accuracy on
42
+ [referee-lab/hands-visible](https://github.com/publu/referee-lab) (45-clip
43
+ provisional development sheet, robot + wildlife domains) — matching gemma3:27b
44
+ on that sheet at 1/18,000th the parameters.
45
 
46
  | Model | Params | Accuracy |
47
  |---|---|---|