JacobLinCool commited on
Commit
cd22718
·
verified ·
1 Parent(s): d69b6f3

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -80,3 +80,34 @@ Both inputs should be normalized and have the same temporal dimensions.
80
  ## Training
81
 
82
  The model was trained to detect misaligned or poorly-synchronized rhythm game charts by comparing music-chart pairs with various synthetic corruptions (time shifts, random note placement, etc).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
80
  ## Training
81
 
82
  The model was trained to detect misaligned or poorly-synchronized rhythm game charts by comparing music-chart pairs with various synthetic corruptions (time shifts, random note placement, etc).
83
+
84
+ ## Evaluation Results
85
+
86
+ Evaluation was performed on 2,204 test samples with various segment durations. The model uses a severity parameter of 0.56.
87
+
88
+ ### Overall Accuracy by Segment Duration
89
+
90
+ | Duration | Overall | Positive | Shift | Random | Mismatch |
91
+ |----------|---------|----------|-------|--------|----------|
92
+ | 5s | 81.85% | 95.69% | 79.04% | 97.41% | 97.41% |
93
+ | 10s | 83.35% | 96.55% | 80.60% | 97.41% | 100.00% |
94
+ | 20s | 84.66% | 96.55% | 82.06% | 99.14% | 100.00% |
95
+ | 30s | 85.30% | 95.69% | 82.81% | 100.00% | 100.00% |
96
+ | 60s | 85.98% | 95.69% | 83.62% | 100.00% | 100.00% |
97
+ | 120s | **86.25%** | 94.83% | **84.00%** | 100.00% | 100.00% |
98
+ | 180s | 85.57% | 94.83% | 83.19% | 100.00% | 100.00% |
99
+
100
+ ### Shift Detection by Offset (120s segment)
101
+
102
+ | Offset | Accuracy | Offset | Accuracy |
103
+ |--------|----------|--------|----------|
104
+ | -0.50s | 91.38% | +0.50s | 92.24% |
105
+ | -0.30s | 89.66% | +0.30s | 89.66% |
106
+ | -0.20s | 91.38% | +0.20s | 94.83% |
107
+ | -0.10s | 100.00% | +0.10s | 100.00% |
108
+ | -0.05s | 100.00% | +0.05s | 100.00% |
109
+ | -0.03s | 91.38% | +0.03s | 95.69% |
110
+ | -0.02s | 84.48% | +0.02s | 88.79% |
111
+ | -0.01s | 20.69% | +0.01s | 13.79% |
112
+
113
+ > **Note**: The ±10ms shifts are at the edge of perceptual timing tolerance and are intentionally difficult to detect.