UnifiedHorusRA commited on
Commit
85f32f7
·
verified ·
1 Parent(s): 591fa99

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +139 -0
README.md ADDED
@@ -0,0 +1,139 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ tags:
5
+ - art
6
+ ---
7
+
8
+ # Flat Color - Style
9
+
10
+ **Creator**: [motimalu](https://civitai.com/user/motimalu)
11
+ **Type**: LORA
12
+ **Base Model**: Wan Video 2.2 TI2V-5B
13
+ **Version**: v2.0 [wan-ti2v-5b]
14
+ **Trigger Words**: `N/A`
15
+
16
+ **Civitai Model ID**: 1132089
17
+ **Civitai Version ID**: 2076237
18
+
19
+ **Stats (at time of fetch for this version)**:
20
+ * Downloads: 438
21
+ * Rating: 0 (0 ratings)
22
+ * Favorites: N/A
23
+
24
+ ---
25
+
26
+ ## 📄 Description (Parent Model)
27
+
28
+ Flat Color
29
+ -
30
+ Style
31
+ Trained on images without visible lineart, flat colors, and
32
+ little to no indication of depth.
33
+ ℹ️ LoRA work best when applied to the base models on which they are trained.
34
+ Please read the
35
+ About This Version
36
+ on the appropriate base models
37
+ and workflow/training information.
38
+ This is a small style LoRA I thought would be interesting to try with a v-pred model (noobai v-pred), for the reduced color bleeding and strong blacks in particular.
39
+ The effect is quite nice and easy to evaluate in training, so I've extended the dataset with videos in following versions for text-to-video models like Wan and Hunyuan, and it is what I am generally using to test LoRA training on new models now.
40
+ Recommended prompt structure:
41
+ Positive prompt:
42
+ flat color, no lineart, blending, negative space,
43
+ {{tags}}
44
+ masterpiece, best quality, very aesthetic, newest
45
+
46
+ ## Version Notes (v2.0 [wan-ti2v-5b])
47
+
48
+ [WAN 2.2 TI2V 5B] LoRA
49
+ Trained with
50
+ diffusion-pipe
51
+ on
52
+ Wan2.2-TI2V-5B
53
+ Experimental - first test for Wan 2.2 training
54
+ Image dataset only
55
+ Less effect at longer framerates
56
+ Text to Video previews generated with
57
+ ComfyUI_examples/wan22/#text-to-video
58
+ Loading the LoRA with LoraLoaderModelOnly node
59
+ dataset.toml
60
+ # Resolution settings.
61
+ resolutions = [1024]
62
+
63
+ # Aspect ratio bucketing settings
64
+ enable_ar_bucket = true
65
+ min_ar = 0.5
66
+ max_ar = 2.0
67
+ num_ar_buckets = 7
68
+
69
+ [[directory]] # IMAGES
70
+ # Path to the directory containing images and their corresponding caption files.
71
+ path = '/mnt/d/training_data/images'
72
+ num_repeats = 5
73
+ resolutions = [1024]
74
+ config.toml
75
+ # Dataset config file.
76
+ output_dir = '/mnt/d/wan/training_output'
77
+ dataset = 'dataset.toml'
78
+
79
+ # Training settings
80
+ epochs = 50
81
+ micro_batch_size_per_gpu = 1
82
+ pipeline_stages = 1
83
+ gradient_accumulation_steps = 4
84
+ gradient_clipping = 1.0
85
+ warmup_steps = 100
86
+ # blocks_to_swap=32
87
+
88
+ # eval settings
89
+ eval_every_n_epochs = 5
90
+ eval_before_first_step = true
91
+ eval_micro_batch_size_per_gpu = 1
92
+ eval_gradient_accumulation_steps = 1
93
+
94
+ # misc settings
95
+ save_every_n_epochs = 5
96
+ checkpoint_every_n_minutes = 30
97
+ activation_checkpointing = true
98
+ partition_method = 'parameters'
99
+ save_dtype = 'bfloat16'
100
+ caching_batch_size = 1
101
+ steps_per_print = 1
102
+ video_clip_mode = 'single_middle'
103
+
104
+ [model]
105
+ type = 'wan'
106
+ ckpt_path = '../Wan2.2-TI2V-5B'
107
+ dtype = 'bfloat16'
108
+ # You can use fp8 for the transformer when training LoRA.
109
+ transformer_dtype = 'float8'
110
+ timestep_sample_method = 'logit_normal'
111
+
112
+ [adapter]
113
+ type = 'lora'
114
+ rank = 32
115
+ dtype = 'bfloat16'
116
+
117
+ [optimizer]
118
+ type = 'adamw_optimi'
119
+ lr = 5e-5
120
+ betas = [0.9, 0.99]
121
+ weight_decay = 0.02
122
+ eps = 1e-8
123
+
124
+ ---
125
+
126
+ ## Civitai Links
127
+
128
+ * **[🔗 View This Version on Civitai →](https://civitai.com/models/1132089?modelVersionId=2076237)**
129
+ * [View Full Model Page →](https://civitai.com/models/1132089)
130
+ * [View Creator Profile →](https://civitai.com/user/motimalu)
131
+
132
+ ---
133
+
134
+ ## File Information
135
+
136
+ * **Filename**: `wan_flat_color_2.2.5b_v2.safetensors`
137
+ * **Size**: 153.82 MB
138
+ * **Hash (AutoV2)**: `A57F9D76BA`
139
+ * **Hash (SHA256)**: `A57F9D76BA9518E92786F1AACACECDCAFDFB145A2CFDD32B217956B27674B9F1`