docs/oregon_ground_truth.md

OSU vs Oregon Ground Truth - Play Detection Progress

This document tracks the ground truth for plays that were missed by the v1 Oregon baseline, and the current status after v2 improvements.

Video Details

• Video: OSU vs Oregon 01.01.25.mkv
• v1 Baseline: output/benchmarks/oregon_v1_baseline.json (144 plays)
• v2 Benchmark: output/benchmarks/oregon_v2_benchmark.json (183 plays)

---

Progress Summary

Metric	v1	v2	Change
Total Plays Detected	144	183	+39
Ground Truth Found	0/22	19/22	+19
Still Missing	22	3	-19

---

v2 Status: Found Plays (19/22) ✅

Opening Kickoff ✅

Video Time	Seconds	Type	v2 Status
~5:00-6:00	~300-360	kickoff	✅ Found at 332.5s (special)

Normal Plays ✅ (3/5 found)

Video Time	Seconds	Type	v2 Status
7:37	457	normal	✅ Found at 458.0s (special)
1:08:56	4136	normal	✅ Found at 4148.5s (timeout) - captured as special/timeout due to clock operator error
2:14:07	8047	final play	✅ Found at 8053.4s (normal)

Punts ✅ (7/7 found)

Video Time	Seconds	Type	v2 Status
16:36	996	punt	✅ Found at 998.0s (special)
48:14	2894	punt	✅ Found at 2893.5s (special)
53:54	3234	punt	✅ Found at 3237.0s (special)
1:32:11	5531	punt	✅ Found at 5530.9s (special)
1:41:47	6107	punt	✅ Found at 6117.9s (special)
2:01:11	7271	punt	✅ Found at 7273.4s (special)
2:06:52	7612	punt	✅ Found at 7611.4s (special)

Field Goals ✅ (2/2 found)

Video Time	Seconds	Type	v2 Status
35:26	2126	field goal	✅ Found at 2131.5s (special)
1:00:50	3650	field goal	✅ Found at 3655.5s (special)

Extra Points (3/4 found)

Video Time	Seconds	Type	v2 Status
22:25	1345	XP	✅ Found at 1343.0s (special)
44:07	2647	XP	✅ Found at 2652.5s (special)
50:13	3013	XP	✅ Found at 3017.0s (special)

Kickoffs (After Scores) ✅ (1/1 found)

Video Time	Seconds	Type	v2 Status
51:27	3087	kickoff	✅ Found at 3084.5s (normal)

2-Point Conversions ✅ (2/2 found)

Video Time	Seconds	Type	v2 Status
1:12:49	4369	2pt	✅ Found at 4374.9s (special)
1:54:30	6870	2pt	✅ Found at 6869.9s (special)

---

v2 Status: Still Missing (3/22) ❌

Video Time	Seconds	Type	Issue	Nearest Plays
1:11:42	4302	normal	Last play of half - end-of-half edge case	4237.9s, 4374.9s (72s gap)
1:51:24	6684	normal	Clock operator error - low clock detection rate in this area	6654.4s, 6719.4s (65s gap)
1:37:36	5856	XP	Clock freezes at 14, graphic cutaway before 25 reset shown	5826.9s, 5904.9s (78s gap)

Root Cause Analysis

1. 4302s (Last play of half): End-of-half edge case where clock behavior doesn't follow normal patterns. The half ends without typical clock reset signals.

2. 6684s (Clock operator error): Only 66% clock detection rate in the video overall. This area likely has poor clock readings, preventing the state machine from detecting the play start/end.

3. 5856s (XP with graphic cutaway): Per manual notes: "Clock freezes at 14 seconds, then graphic cutaway before 25 reset shown". The 25 reset that triggers special play detection never appears on screen.

---

Additional Issues (from v1) - Status

Special Play End Logic Issue ✅ FIXED

Special plays now end at the first of: 10 seconds OR scorebug disappears.

FLAG Merge Duplication Issue ✅ FIXED

FLAG events no longer duplicate the end of normal plays.

Special Play Clip Buffer Issue ✅ FIXED

Different buffer timing now applied per play type:

• Normal: 2.0s pre / 2.0s post
• Special: 3.5s pre / 0s post
• Flag: 1.0s pre / 0s post
• Timeout: 0s / 0s

---

v2 Improvements Summary

Key fixes that improved detection from 144 → 183 plays:

1. Clock freeze → 25 detection: Detects plays where clock freezes then resets to 25 (punts, FGs, XPs)
2. Scorebug template_matched separation: Fixed Oregon-specific scorebug detection issues
3. Special play tracking improvements: Better handling of 40→25 transitions
4. Opening kickoff detection: Now captures the first play of the game

---

Baseline Comparison

Category	v1 Missed	v2 Found	v2 Still Missing
Opening Kickoff	1	1	0
Normal Plays	5	3	2
Punts	7	7	0
Field Goals	2	2	0
Extra Points	4	3	1
Kickoffs	1	1	0
2PT Conversions	2	2	0
TOTAL	22	19	3