File size: 12,194 Bytes
8fb6219 0eeaf39 22ad378 8fb6219 0eeaf39 8fb6219 5caf5e4 8fb6219 113ecf5 1374446 f5afb4c 7428ce0 ea80530 cc37c19 ea80530 411a037 72bf9a7 b3d3815 f5afb4c 571ed10 f5afb4c 419f0f2 0c6094b b3d3815 f5afb4c 93f1d40 05ad25e c5468a0 e530748 be8428d c5468a0 1997d86 e530748 376a586 be8428d c5468a0 fd889ac 9e7faa9 be8428d 345bb1e b294e44 05ad25e fd889ac 8a61257 1ecf654 f5afb4c 05ad25e 17b98fd 05ad25e 345bb1e 05ad25e 345bb1e 05ad25e e75557a 19846f2 c1d50a3 19846f2 05ad25e f5afb4c 05ad25e 17b98fd 05ad25e 345bb1e 05ad25e f5afb4c 1339952 05ad25e 17b98fd 05ad25e 345bb1e 05ad25e 345bb1e 05ad25e f5d3cef 05ad25e f5afb4c 05ad25e 1339952 05ad25e f5afb4c 05ad25e 345bb1e 05ad25e b3d3815 f5afb4c 571ed10 f5afb4c 72bf9a7 5caf5e4 72bf9a7 0d0ce20 ca09175 f5afb4c 8fbcbac 5caf5e4 8fbcbac 0d0ce20 3b8715b 8fb6219 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 | ---
license: mit
base_model:
- krea/Krea-2-Raw
- krea/Krea-2-Turbo
tags:
- lora
- character
- girl
- flux
- pony
- sd1.5
- text-to-image
- krea2
- moss
pipeline_tag: text-to-image
---
---
## Viewer: <a href="https://huggingface.co/spaces/waveshaker/loras_gallery" target="_blank">**🖼️LoRAs Gallery**</a>
<a href="https://huggingface.co/spaces/waveshaker/loras_gallery" target="_blank">
<img src="https://huggingface.co/waveshaker/loras/resolve/main/preview/preview1.webp" style="width: 100%; max-width: 683px; height: auto; border-radius: 6px; border: 1px solid #333; display: block; margin: 0 0 16px 0;" alt="MainPage">
</a>
---
## Dataset: <a href="https://huggingface.co/datasets/waveshaker/dataset_collections" target="_blank">**📊Dataset Collections**</a>
---
## Tools for this repo: <a href="https://huggingface.co/waveshaker/loras_tools" target="_blank">**🔨Loras Tools s**</a>
---
## Training Configuration & Training Tools
- <details>
<summary><strong>Moss Image</strong> (Click to expand)</summary>
- Training Tools: [Onetrainer (Koratahiu‘s Fork)](https://github.com/Koratahiu/OneTrainer/tree/moss-image) / [Fizgig](https://github.com/shootthesound/Fizgig) / [Fizgig-Advanced(Murf-Code's Fork)](https://github.com/Murf-Code/Fizgig-Advanced)
- Dataset: Mostly 50+ images (averaging 100+)
- Tagging Style: Mixed format (Booru tags as prefixes combined with natural language)
- Repeats per Image: 50+
- Training Parameters: Default settings from Onetrainer / Fizgig
- Onetrainer tweak:
- Attention:`torch CuDNN` (overriding the default SDPA)
- Training Res: 512
- LR:`1.5e-04 - 2.5e-04`
- Batch Size::`3 - 4`
- Fizgig tweak:
- Presets: `Moss-Image Fast(rank 16, 0.25MP)`
- Pictrue Size: `0.26 MP` ≈ 512 res
- LR:`1e-04`
- Gradient Accumulation: `3`
- Fizgig-Advanced tweak:
- Presets: `Moss-Image Fast(rank 16, 0.25MP)`
- Pictrue Size: `0.26 MP` ≈ 512 res
- LR:`1.5e-04 - 2.5e-04`
- Batch Size: `3 - 4`
- Training Speed (Benchmark: 39 imgs, 0.26MP, r16):
- OneTrainer: 910 steps, 1.12 s/it (`Local Batch Size: 3, LR: 0.0003`) → ~0.37s/img (17m 43s)
- Fizgig(Batch-Size: Not Supported): 2730 steps, 1.25 it/s (`Gradient Accumulation: 3, LR: 0.0001`) → ~0.83s/img (36m 17s)
- Fizgig-Advanced(Batch-Size: Supported): 910 steps, 2.07 s/it (`Batch Size: 3, LR: 0.0003`) → ~0.69s/img (31m 20s)
- *(Note on Speed & Formats: OneTrainer used the official sharded Diffusers format (bfloat16), while Fizgig used the ComfyUI single-file int8 format.)*
- Showcase & Card Image Parameters:
- [MOSS Image SFT(int8)](https://huggingface.co/OpenMOSS-Team/MOSS-Image-SFT)
- [PornMaster Moss SFT V1](https://civitai.red/models/3008033/pornmaster-moss?modelVersionId=3413227)
- [Kromoss v1.0](https://civitai.red/models/3015170/kromoss?modelVersionId=3422515)
- [Moody Moss Mix v4.1](https://civitai.red/models/3007871/moody-moss-mix-free-download?modelVersionId=3449754)
- LoRA Weight: 0.8 ~ 1
> #### LR / Batch Size / Gradient Accumulation
>
> - **Effective Batch Size** = `Batch Size × Gradient Accumulation`. Gradient accumulation saves VRAM but is slower; a larger Batch Size is faster but uses more VRAM.
> - **LR Scaling**: Don't blindly apply the linear rule to LoRA. Validate with loss curves. (My baseline: `Batch 3` + `LR 0.0003`). *Note: The vanilla Fizgig benchmark used the default `LR 0.0001`, which is under-scaled for an effective batch of 3. As widely discussed on GitHub and Reddit, increasing the batch size generally requires a higher LR to compensate for fewer update steps.*
>
> #### Paper TL;DR:
> - [*Accurate, Large Minibatch SGD* (2017)](https://arxiv.org/abs/1706.02677): The "Linear Scaling Rule" — if you multiply batch size by k, multiply LR by k. This was designed for full fine-tuning on ImageNet, not LoRA (e.g., `BS 1, LR 1e-4` → `BS 4, LR 4e-4`).
> - [*One weird trick for parallelizing CNNs* (2014)](https://arxiv.org/abs/1404.5997): The "Square Root Scaling Rule" — if you multiply batch size by k, to keep gradient variance stable, scale LR by ***k^0.5*** instead of k. More conservative when batch gets very large (e.g., `BS 1, LR 1e-4` → `BS 4, LR 2e-4`).
> - [*Beware of the Batch Size* (2026)](https://arxiv.org/abs/2602.09492): For LoRA specifically, batch size is not just a multiplier for LR — it's a **first-order design parameter**. Optimal batch depends on dataset size (most sensitive), rank, and model capacity. Vanilla LoRA matches fancy variants when batch is tuned properly.
</details>
- <details>
<summary><strong>Krea2</strong> (Click to expand)</summary>
- Training Tools: [Onetrainer](https://github.com/nerogar/OneTrainer)
- Dataset: Mostly 50+ images (averaging 100+)
- Tagging Style: Mixed format (Booru tags as prefixes combined with natural language)
- Training Res: 512
- Repeats per Image: 50+
- Training Parameters: Default settings from Onetrainer
- Showcase & Card Image Parameters:
- Model:
- [Krea 2 Turbo](https://huggingface.co/krea/Krea-2-Turbo)
- [Dark Beast 2](https://civitai.com/models/2242173/darkbeast-6x-in-context-ref2i-5c?modelVersionId=3078453)
- [Kreamania v6](https://civitai.com/models/2729631/kreamania?modelVersionId=3181498)
- [Moody Krea 2 Mix V8](https://civitai.red/models/2731187/moody-krea-2-mix-v9-is-here-v8se-free?modelVersionId=3327244)
- [Moody Krea 2 Mix V5](https://civitai.red/models/2731187/moody-krea-2-mix-v9-is-here-v8se-free?modelVersionId=3151928)
- [GonzaLomo Krea 2](https://civitai.red/models/2761943/gonzalomo-krea-2?modelVersionId=3245099)
- [Krea2RedMix 3.0](https://civitai.red/models/958009/redcraft-or?modelVersionId=3139241)
- [kroma-v0.3.1-turbo-opd-W8A8](https://civitai.red/models/2997793/kroma-krea-2?modelVersionId=3400188)
- [kroma-v0.3-turbo-int8](https://civitai.red/models/2901933/kroma-3-turbo-int8-convrot)
- [kroma-v0.2-turbo-int8](https://civitai.red/models/2846465/kroma-int8convrot-for-comfyui)
- LoRA Weight: 0.8 ~ 1
</details>
- <details>
<summary><strong>Anima</strong> (Click to expand)</summary>
- Training Tools: [Onetrainer](https://github.com/nerogar/OneTrainer)
- Dataset: 20 ~ 100 images
- Tagging Style: Mixed format (Booru tags as prefixes combined with natural language)
- Training Res: 512
- Repeats per Image: 50+
- Training Parameters: Mostly default settings from Onetrainer
- Showcase & Card Image Parameters:
- Model:
- [Diving Anima v40](https://civitai.red/models/2723760/diving-anima?modelVersionId=3139102)
- LoRA Weight: 0.8 ~ 1
</details>
- <details>
<summary><strong>Flux.1-dev</strong> (Click to expand)</summary>
- Training Tools: [Kohya_ss](https://github.com/bmaltais/kohya_ss) / [AI-Toolkit](https://github.com/ostris/ai-toolkit) / [lora-scripts v1.11.0](https://github.com/Akegarasu/lora-scripts/tree/aa3cba0d481fb9e1c17263965077df4d19f86c86)
- Dataset: 20-50 images
- Tagging Style: Early stages used Booru tags; later shifted to natural language descriptive captions
- Training Res: 512
- Repeats per Image: 50+
- Training Parameters: Mostly default settings from Kohya_ss / AI-Toolkit / lora-scripts v1.11.0 (*lr* may differ in Kohya_ss & lora-scripts)
- Showcase & Card Image Parameters:
- Model:
- [FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
- [RedCraft New REVE[A]L](https://civitai.com/models/958009/redcraft-or-or-hybrid-h3-and-krea2t-and-qw21-fixed-w6a8?modelVersionId=1315432)
- [UltraReal Fine-Tune](https://civitai.com/models/978314/ultrareal-fine-tune?modelVersionId=1413133)
- [BEYOND REALITY 超越真实 v3](https://civitai.com/models/1090420/beyond-reality?modelVersionId=2648189)
- LoRA Weight: 0.8 ~ 1
</details>
- <details>
<summary><strong>Stable Diffusion v1.5</strong> & <strong>Pony Diffusion V6 XL</strong> (Click to expand)</summary>
- Tool: [Kohya Colab](https://github.com/hollowstrawberry/kohya-colab) / [Kohya_ss](https://github.com/bmaltais/kohya_ss) / [lora-scripts v1.11.0](https://github.com/Akegarasu/lora-scripts/tree/aa3cba0d481fb9e1c17263965077df4d19f86c86)
- Dataset: 50-200 images
- Tagging Style: Booru tags
- Training Res: 1024+
- Repeats per Image: 30 - 50
- Training Parameters: Mostly default settings from the Colab notebook / Kohya_ss / lora-scripts (*lr* may differ in Kohya_ss & lora-scripts)
- Showcase & Card Image Parameters:
- Model:
- PONY: [WAI-ANI-HENTAI-PONYXL v6](https://civitai.com/models/553648/wai-ani-hentai-ponyxl)
- SD1.5: [t3 sd ver3](https://civitai.com/models/110053/t3)
- SD1.5: [MeichiDarkMix_Legacy](https://civitai.com/models/647171/meichidarkmixlegacy)
- SD1.5: [RedCraft Resolution 1.5](https://civitai.com/models/958009/redcraft-or-or-hybrid-h3-and-krea2t-and-qw21-fixed-w6a8?modelVersionId=1298797)
- LoRA Weight: 0.8 ~ 1
</details>
---
## Usage Disclaimer
1. **Educational & Research Purpose Only**: This repository hosts LoRA models trained on various base models, including Pony, Flux 1 Dev, Anima, Krea2, Moss Image, and SD1.5. All models are intended solely for academic exchange, technical testing, and personal research into image generation algorithms.
2. **Prohibition of Illegal Use**: Users must strictly adhere to local laws and regulations when downloading and using these models. It is strictly forbidden to use these models to infringe upon others' privacy, reputation, portrait rights, or other legitimate interests. Do not use them for creating or spreading misinformation, fraudulent activities, or any unethical purposes.
3. **Takedown Notice**: These models are shared for non-commercial research purposes. If you are a copyright owner or an authorized agent and believe that any content in this repository infringes upon your rights, please contact me directly. I will promptly review and remove the infringing material upon verification, without any delay.
4. **Content Compliance Notice**: Please be aware that certain base models (e.g., Pony) may exhibit a high degree of openness regarding specific prompts. Users are entirely responsible for filtering and auditing the compliance of the generated content.
5. **Limitation of Liability**: As the creator/tester of these experimental models, I take no responsibility for any direct or indirect legal liabilities, losses, or disputes arising from the use of this repository. Any image generated and its subsequent consequences are the sole responsibility of the user.
---
## 使用免责声明
1. **仅限教育与研究目的**:本仓库托管了基于多种基础模型(包括 Pony、Flux 1 Dev、Krea2、Moss Image、Anima 和 SD1.5)训练的 LoRA 模型。所有模型仅供学术交流、技术测试以及个人对图像生成算法的研究使用。
2. **禁止非法使用**:用户在下载和使用这些模型时,必须严格遵守当地的法律法规。严禁使用这些模型侵犯他人的隐私、名誉、肖像权或其他合法权益。不得将其用于制造或传播虚假信息、欺诈活动或任何不道德的目的。
3. **侵权通知与删除**:本仓库模型仅限非商业研究分享。如果您是版权所有者或授权代理人,并认为本仓库中的任何内容侵犯了您的权利,请直接与我联系。核实后,我将立即审查并毫不拖延地删除相关的侵权内容。
4. **内容合规提示**:请注意,某些基础模型(如 Pony)在特定提示词方面可能具有较高的开放性。用户需全权负责对生成内容的合规性进行过滤和审查。
5. **责任限制**:作为这些实验性模型的创建者/测试者,我对因使用本仓库而产生的任何直接或间接的法律责任、损失或纠纷概不负责。任何生成的图像及其后续产生的一切后果,均由用户自行承担全部责任。
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |