the stream input works great
#18
by mzbac - opened
Thanks for the great work. I have ported the model inference code to Swift and tested the stream input. I think it will enable real-time conversation on a single Mac machine.
https://x.com/LiMzba/status/1999457581228785875?s=20