How to deploy LTX2.3 as a service in ubuntu system?
#55
by danielHang - opened
I use SGLang to deploy LTX2.3, but do I need the configuration files of LTX2.3 when starting up, such as model_index.json, etc.?
How much memory is needed? I have 64G of memory and 64GB of swap memory. However, the error -9 is still reported during startup. Does this mean there is insufficient memory? Is there an official document? I'm not using comfyui to deploy, I want to deploy it as a service
We don't have official documentation for SGLang support. If there's enough demand we can look at adding that.
Error -9 is an OOM so yes, that's not enough memory. Which version of the model checkpoint are you using? If it's not Lightricks/LTX-2.3-fp8, give that a try.
rluxemburg changed discussion status to closed