Image-Text-to-Video
Diffusers
Safetensors
English
world-model
world-simulation
text-to-video
image-to-video
diffusion-transformer
Instructions to use IFM/PAN2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use IFM/PAN2 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("IFM/PAN2", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
No audio vae?
#2
by Winnougan - opened
Hi guys, I was playing around with your model on an RTX 6000 and learned that you have no audio vae? Is that by design? Will you eventually add one? Video is decent but produces no sound without the audio vae. Thanks/Choukrane
Hi Winnougan, thanks for trying PAN 2 and for the feedback.
PAN 2 currently generates video only, so silent output is expected. Sound is on our radar, but we don't have a release or timeline to share yet. We'll post here when that changes. We appreciate you taking the time to test it.