fhai50032/ControlNet-Poster
Viewer • Updated • 8.18k • 18 • 2
How to use fhai50032/flux-controlnet-1000 with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("fhai50032/flux-controlnet-1000", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]This repository hosts Flux-ControlNet, a customized ControlNet-based diffusion model designed for generating text-embedded images.
General Parameters:
Model Architecture: Flux-based ControlNet Model
Image Resolution: 512x512
Batch Size: 4
Epochs: 50
Optimizer: AdamW
Learning Rate: 1e-5 (with cosine schedular)
Weight Decay: 0.01
Gradient Clipping: 1.0
Soon to be added
Base model
black-forest-labs/FLUX.1-dev