Good model performance, slow inference speed is, any optimization tips?
#5
by alejandrocastaneira - opened
Hi, thanks for exporting LayoutReader to the HuggingFace Hub. Performance is quite good. However, we’re seeing slow inference speed. Are there any recommended ways to optimize or speed up inference?
Thanks a lot!