Jax code for inference?

by james-golden-arcadia - opened Sep 5, 2025

Would you consider releasing Jax code for inference? I am hoping to take advantage of Jax compilation for VRAM-efficient inference on long sequences.

Thank you again for this excellent model!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment