Add W8A16-stream-multifunction SpeechDecoder

#3
by EduardoPacheco - opened

Adds the streaming SpeechDecoder (ring KV cache, sliding-window attention) for 12hz-0.6b-customvoice and 12hz-1.7b-customvoice. It is faster than W8A16-multifunction across devices and runs fully on the ANE on A14/A15. Existing W8A16 and W8A16-multifunction assets are unchanged.

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment