Coldbrew9 commited on
Commit
adb7369
·
verified ·
1 Parent(s): abab201

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +26 -0
README.md CHANGED
@@ -1,3 +1,29 @@
1
  ---
2
  license: cc-by-nc-sa-4.0
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-sa-4.0
3
+ tags:
4
+ - image-generation
5
+ - diffusion
6
+ - lora
7
+ - CatVTON
8
  ---
9
+
10
+ # CatVTON LoRA Model
11
+
12
+ ## Model Description
13
+ This is a LoRA fine-tuned model based on the CatVTON pipeline for virtual try-on tasks. It uses a pre-trained Stable Diffusion inpainting model combined with attention mechanisms from CatVTON.
14
+
15
+ ## Training
16
+ - **Base Model**: `booksforcharlie/stable-diffusion-inpainting`
17
+ - **Attention Checkpoint**: `zhengchong/CatVTON`
18
+ - **LoRA Rank**: 4
19
+ - **Epochs**: 10
20
+ - **Batch Size**: 8
21
+ - **Learning Rate**: 1e-4
22
+
23
+ ## Usage
24
+ ```python
25
+ from peft import PeftModel, LoraConfig
26
+ from diffusers import StableDiffusionInpaintPipeline
27
+
28
+ base_model = StableDiffusionInpaintPipeline.from_pretrained("booksforcharlie/stable-diffusion-inpainting")
29
+ lora_model = PeftModel.from_pretrained(base_model.unet, "Coldbrew9/wheel-CatVTON")