Instructions to use lllyasviel/FramePackI2V_HY with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use lllyasviel/FramePackI2V_HY with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("lllyasviel/FramePackI2V_HY", torch_dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
ComfyUI Framepack on RTX 4060 - Black Output & 'clip missing'
Hi all, having trouble getting Framepack to work in ComfyUI on my RTX 4060 (8GB VRAM). I keep getting black output and the error: clip missing: ['text_projection.weight'].
I've checked and the llava_llama3_fp8_scaled.safetensors and clip_l.safetensors files are in my ComfyUI/models/text_encoders folder. The Framepack model (...FramePackI2V_HY_fp8_e4m3fn.safetensors) is in ComfyUI/models/diffusion_models, sigclip (...sigclip_vision_patch14_384.safetensors) in ComfyUI/models/clip_vision, and the VAE (...hunyuan_video_vae_bf16.safetensors) in ComfyUI/models/vae.
Anyone else run into this 'clip missing' issue with Framepack and similar hardware, or have any thoughts on what might be the cause? Really looking forward to trying this out. Thanks!
Switching to the BF16 model prevented the black output.
Did not encounter clip missing and am running on AMD 6800