Card: decode speed after the attention change 2ab6895 verified alexwengg commited on about 19 hours ago
Decoder: concatenate attention scores instead of K/V (no per-layer cache copy, ~17% faster decode, same output) 51046f0 verified alexwengg commited on about 19 hours ago
Unlimited-OCR Core ML: fp16 page encoder + int8 stateful multi-page decoder 9921f1f verified alexwengg commited on about 21 hours ago