Instructions to use cerspense/zeroscope_v2_576w with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use cerspense/zeroscope_v2_576w with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("cerspense/zeroscope_v2_576w", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Finetuning
#38
by juliajoanna - opened
Hi,
great work!
I am currently finetuning Zeroscope on my own dataset using the code from Github. The problem is that the finetuned model produces a lot of noise and artifacts on generated videos. I wonder what the reason is. How did you finetune Modelscope? What hyperparameters, like fps, dataset normalization or frame step, did you use? Did you train both on videos and images or not?
Thanks in advance.