Instructions to use LanguageBind/Open-Sora-Plan-v1.3.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use LanguageBind/Open-Sora-Plan-v1.3.0 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("LanguageBind/Open-Sora-Plan-v1.3.0", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
模型对应关系-生成效果
#3
by AndyJin - opened
python -m opensora.serve.gradio_web_server --model_path "path/to/model"
--ae WFVAEModel_D8_4x8x8 --ae_path "path/to/vae"
--caption_refiner "path/to/refiner"
--text_encoder_name_1 "path/to/text_enc" --rescale_betas_zero_snr
--model_path指代发布的any93640640
--ae指代发布的vae文件夹下的模型
--caption_refiner对应prompt_refiner的文件,
--text_encoder_name_1 对应DeepFloyd/t5-v1_1-xxl
这个有问题吗?生成的效果如下
9 hours for this? why they release it anyway...