Instructions to use xumouyi/pose-control-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use xumouyi/pose-control-lora with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("black-forest-labs/FLUX.1-Fill-dev", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("xumouyi/pose-control-lora") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Layer Selection and Training Details for FLUX.1-Fill LoRAs
#2
by KappaNeuro - opened
Question 1: Selection of Layers for Training
Why were not all layers involved in training the LoRA for pose-control-lora based on Fill FLUX.1-Fill-dev?
- What was the rationale behind selecting these specific layers?
- Were there any experiments conducted with other configurations, such as training a greater or fewer number of layers? What were the results?
- How did this choice impact the model’s performance and its generalization ability?
Question 2: Training Details
What data was used for training the LoRA, and was any preprocessing applied?
- What hyperparameters were chosen and why?
- Were there any challenges during the training process, and how were they addressed?
Question 3: Pipeline
What pipeline was used for training?
- What tools and frameworks were applied?
- Were there any modifications to the standard training process?
- Were additional optimization methods or custom solutions implemented?