Upload lora/f2k_9B_lcs_consist_20260415_README.md with huggingface_hub
Browse files
lora/f2k_9B_lcs_consist_20260415_README.md
ADDED
|
@@ -0,0 +1,194 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
tags:
|
| 4 |
+
- tool
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
+
# Consistence Edit Lora - Klein 9B lcs 20260416 - 2863285
|
| 8 |
+
|
| 9 |
+
**Model Type**: LORA
|
| 10 |
+
|
| 11 |
+
**Base Model**: Flux.2 Klein 9B-base
|
| 12 |
+
|
| 13 |
+
**Trigger Words**: transform the image to realistic photograph. add realistic details to the corrupted image. restore high frequence details from the corrupted image.
|
| 14 |
+
|
| 15 |
+
**Tags**: tool
|
| 16 |
+
|
| 17 |
+
## Gallery
|
| 18 |
+
|
| 19 |
+
<table>
|
| 20 |
+
<tr>
|
| 21 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/44752613-de45-414e-bc4f-2899c0829fa1/original=true/127711698.jpeg" width="200"></td>
|
| 22 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/a2d27bfd-db52-4c48-a57b-f2f4b1561e7f/original=true/127711701.jpeg" width="200"></td>
|
| 23 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b844a192-0220-4c4f-9cf5-7e62d40711b6/original=true/127711703.jpeg" width="200"></td>
|
| 24 |
+
</tr>
|
| 25 |
+
<tr>
|
| 26 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d77c7bb6-cf8f-42fb-83c3-5181dfe5e389/original=true/127711706.jpeg" width="200"></td>
|
| 27 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/baff31a8-4742-44e8-8a20-1215b3faa778/original=true/127711707.jpeg" width="200"></td>
|
| 28 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/6dffc494-fc14-4ccc-a044-c5f60458beb6/original=true/127711709.jpeg" width="200"></td>
|
| 29 |
+
</tr>
|
| 30 |
+
<tr>
|
| 31 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/9856307d-6982-4540-a86f-5d136b596ac9/original=true/127711714.jpeg" width="200"></td>
|
| 32 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/77657de5-ccd5-43a3-bf62-e358911d5064/original=true/127711717.jpeg" width="200"></td>
|
| 33 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b6869fb3-b976-4bc6-bf2d-e7ce5e105297/original=true/127711719.jpeg" width="200"></td>
|
| 34 |
+
</tr>
|
| 35 |
+
<tr>
|
| 36 |
+
<td><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f46c9ffa-3836-4dec-b272-e2bfa282aab1/original=true/127711724.jpeg" width="200"></td>
|
| 37 |
+
</tr>
|
| 38 |
+
</table>
|
| 39 |
+
|
| 40 |
+
## Description
|
| 41 |
+
|
| 42 |
+
Klein 9B lcs consistency lora 20260415
|
| 43 |
+
|
| 44 |
+
RunningHub:
|
| 45 |
+
|
| 46 |
+
Lora:
|
| 47 |
+
|
| 48 |
+
<https://www.runninghub.ai/model/public/2044762492517228546?inviteCode=rh-v1279>
|
| 49 |
+
|
| 50 |
+
Online Workflow:
|
| 51 |
+
|
| 52 |
+
<https://www.runninghub.ai/post/2016109710943981570/?inviteCode=rh-v1279>
|
| 53 |
+
|
| 54 |
+
Klein 9B consist lcs preivew 20260328
|
| 55 |
+
|
| 56 |
+
preview version of lcs training method.
|
| 57 |
+
|
| 58 |
+
Further version is under development
|
| 59 |
+
|
| 60 |
+
Klein 4B Consistency Lora
|
| 61 |
+
|
| 62 |
+
This lora inspired by ByteDance [Heilos](https://github.com/PKU-YuanGroup/Helios) Easy Anti-Drifting method.
|
| 63 |
+
|
| 64 |
+
I implemented Frame-Aware Corrupt (Reference Latent Corrupt) latent and Color Statistics Loss.
|
| 65 |
+
|
| 66 |
+
In additionally, I use frequence split dataset which created by converting an image into frequence domain and split it into high freq image and low freq image.
|
| 67 |
+
|
| 68 |
+
Reference: low freq image, high freq image (0.8 dropout rate on high freq image)
|
| 69 |
+
|
| 70 |
+
Target: clean image
|
| 71 |
+
|
| 72 |
+
lr: 2e-4
|
| 73 |
+
|
| 74 |
+
scheduler: cosine
|
| 75 |
+
|
| 76 |
+
optimizer: adamw8bit
|
| 77 |
+
|
| 78 |
+
steps: 6000
|
| 79 |
+
|
| 80 |
+
Suggested Prompt:
|
| 81 |
+
|
| 82 |
+
{edit prompt}. Transform the image to realistic photograph. add realistic details to the corrupted image. restore high frequence details from the corrupted image.
|
| 83 |
+
|
| 84 |
+
Suggested Strength:
|
| 85 |
+
|
| 86 |
+
0.5-0.7
|
| 87 |
+
|
| 88 |
+
Trained on 4B based. This lora aims to preserve image consistence across multiple input images. Control the lora via lora strength.
|
| 89 |
+
|
| 90 |
+
More strength means more consistence but it would also hurt edit abilities.
|
| 91 |
+
|
| 92 |
+
Different image might has different optimal lora strength.
|
| 93 |
+
|
| 94 |
+
Running Hub
|
| 95 |
+
|
| 96 |
+
Flux2 Klein 4B一致性lora对比 runninghub.ai/post/2032812180667633666/?inviteCode=rh-v1279
|
| 97 |
+
|
| 98 |
+
Flux2 Klein 4B一致性lora 不偏色 不偏移 runninghub.ai/post/2032817113190113281/?inviteCode=rh-v1279
|
| 99 |
+
|
| 100 |
+
Flux2 Klein 9B Consist Lora
|
| 101 |
+
|
| 102 |
+
HuggingFace:
|
| 103 |
+
|
| 104 |
+
<https://huggingface.co/lrzjason/Consistance_Edit_Lora>
|
| 105 |
+
|
| 106 |
+
Klein 9B Consis Lora
|
| 107 |
+
|
| 108 |
+
Suggested Prompt:
|
| 109 |
+
|
| 110 |
+
restore image details
|
| 111 |
+
|
| 112 |
+
Flux2 Klein 9B Consis Lora
|
| 113 |
+
|
| 114 |
+
Trained on 9B based. This lora aims to preserve image consistence across multiple input images. Control the lora via lora strength.
|
| 115 |
+
|
| 116 |
+
Suggested strength: 0.2~1.5
|
| 117 |
+
|
| 118 |
+
Use with any prompts.
|
| 119 |
+
|
| 120 |
+
More strength means more consistence but it would also hurt edit abilities.
|
| 121 |
+
|
| 122 |
+
Different image might has different optimal lora strength.
|
| 123 |
+
|
| 124 |
+
RH:
|
| 125 |
+
|
| 126 |
+
<https://www.runninghub.ai/post/2016109710943981570/?inviteCode=rh-v1279>
|
| 127 |
+
|
| 128 |
+
======================QE2511================================
|
| 129 |
+
|
| 130 |
+
RH:
|
| 131 |
+
|
| 132 |
+
<https://www.runninghub.ai/model/public/2010085010870640641?inviteCode=rh-v1279>
|
| 133 |
+
|
| 134 |
+
Custom\_node:
|
| 135 |
+
|
| 136 |
+
<https://github.com/lrzjason/Comfyui-QwenEditUtils>
|
| 137 |
+
|
| 138 |
+
QE2511 Alpha is trained on QwenEdit 2511.
|
| 139 |
+
|
| 140 |
+
As same as previous lora, this lora helps to maintain image consistence.
|
| 141 |
+
|
| 142 |
+
The lora is trained using nf4 qlora.
|
| 143 |
+
|
| 144 |
+
V2 lora is trained for QwenEditPlus aka QwenImage Edit (2509)
|
| 145 |
+
|
| 146 |
+
It is recommanded to use with strength between 0.5 ~1.0 for multiple images
|
| 147 |
+
|
| 148 |
+
0~0.5 for single image
|
| 149 |
+
|
| 150 |
+
It needs to use with workflow v4.0 [https://civitai.com/models/1939540](https://civitai.com/models/1939540?modelVersionId=2256750)
|
| 151 |
+
|
| 152 |
+
RH workflow:
|
| 153 |
+
|
| 154 |
+
QwenEdit Consistence Edit workflow v4.0
|
| 155 |
+
|
| 156 |
+
Experience link: <https://www.runninghub.ai/post/1965033238311915522>[/?inviteCode=rh-v1279](https://www.runninghub.ai/post/1965033238311915522/?inviteCode=rh-v1279)
|
| 157 |
+
|
| 158 |
+
QwenEdit Consistence Edit workflow v2.0
|
| 159 |
+
|
| 160 |
+
Solved pixels shift issue and keep qwenvl encode image ability.
|
| 161 |
+
|
| 162 |
+
RH workflow:
|
| 163 |
+
|
| 164 |
+
QwenEdit Consistence Edit workflow v2.0
|
| 165 |
+
|
| 166 |
+
Experience link: <https://www.runninghub.ai/post/1965033238311915522/?inviteCode=rh-v1279>
|
| 167 |
+
|
| 168 |
+
Trained with no ref image into qwenvl.
|
| 169 |
+
|
| 170 |
+
This lora typical to test the consistency with kontext like workflow.
|
| 171 |
+
|
| 172 |
+
It is suggested to use 0.45~0.5 lora stregth
|
| 173 |
+
|
| 174 |
+
Workflow:
|
| 175 |
+
|
| 176 |
+
<https://civitai.com/models/1939540/qwenedit-consistance-edit-workflow>
|
| 177 |
+
|
| 178 |
+
RH workflow:
|
| 179 |
+
|
| 180 |
+
It's extremely fun and I highly recommend it to you!
|
| 181 |
+
|
| 182 |
+
Workflow: QwenEdit Consistence Edit workflow
|
| 183 |
+
|
| 184 |
+
Experience link: <https://www.runninghub.ai/post/1965033238311915522/?inviteCode=rh-v1279>
|
| 185 |
+
|
| 186 |
+
---
|
| 187 |
+
|
| 188 |
+
Author: [xiaozhijason](https://civitai.com/user/xiaozhijason)
|
| 189 |
+
|
| 190 |
+
Model: [CivitAI Model Page](https://civitai.com/models/1939453?modelVersionId=2863285)
|
| 191 |
+
|
| 192 |
+
Archive: [CivArchive Page](https://civarchive.com/models/1939453?modelVersionId=2863285)
|
| 193 |
+
|
| 194 |
+
<!-- Version: 20260428_single_create -->
|