Good model performance, slow inference speed is, any optimization tips?

#5
by alejandrocastaneira - opened

Hi, thanks for exporting LayoutReader to the HuggingFace Hub. Performance is quite good. However, we’re seeing slow inference speed. Are there any recommended ways to optimize or speed up inference?

Thanks a lot!

Sign up or log in to comment