janine / README.md
getrushed's picture
Upload README.md
e5f6599 verified
|
Raw
History Blame Contribute Delete
2.2 kB
---
license: other
tags:
- lora
- text-to-image
- image-to-video
- flux
- wan2.2
- character
base_model:
- black-forest-labs/FLUX.1-dev
- Wan-AI/Wan2.2
instance_prompt: janine
pipeline_tag: text-to-image
---
# Janine LoRA
Character LoRA of **Janine**, an AI-generated (synthetic) person. Trained on a 40-image
dataset with detailed natural-language captions. This repository contains adapters for
**two different base models** β€” pick the one that matches your generation pipeline.
> **Trigger word:** `janine` β€” include it in every prompt, e.g. `janine, a woman walking in a garden`.
## Files
| File | Base model | Use for |
|------|-----------|---------|
| `janine_flux_lora.safetensors` | FLUX.1-dev | Still images |
| `janine_wan22_high_noise.safetensors` | Wan 2.2 | Video (high-noise expert) |
| `janine_wan22_low_noise.safetensors` | Wan 2.2 | Video (low-noise expert) |
A LoRA only works with the base model it was trained on β€” the Flux file will **not** load
on Wan, and vice versa.
## Usage in ComfyUI
### Images (Flux)
1. Put `janine_flux_lora.safetensors` in `ComfyUI/models/loras/`.
2. Load a **FLUX.1-dev** checkpoint, add a **Load LoRA** node.
3. Suggested LoRA strength: **0.8–1.0**.
4. Prompt with the trigger, e.g. `janine, a woman wearing a white shirt, soft window light, close-up portrait`.
### Video (Wan 2.2)
Wan 2.2 uses a MoE (high-noise + low-noise) architecture, so this repo ships **two** files.
1. Put both `janine_wan22_*.safetensors` in `ComfyUI/models/loras/`.
2. In your Wan 2.2 workflow, load the **high_noise** LoRA on the high-noise model and the
**low_noise** LoRA on the low-noise model.
3. Prompt with the trigger `janine`.
Tip: for image-to-video you can also generate a still with the Flux LoRA first, then animate
it with a standard Wan i2v workflow β€” no video LoRA required.
## Training
- Dataset: 40 images, captioned in natural language, each starting with the trigger `janine`.
- Flux: ~2000 steps, learning rate 1e-4, LoRA rank 16.
- Wan 2.2: ~2000 steps, learning rate 2e-4, LoRA rank 32.
- Trained on WaveSpeedAI.
## Notes
Janine is a fully synthetic, AI-generated character and does not depict a real person.