UnifiedHorusRA commited on
Commit
ffc1544
·
verified ·
1 Parent(s): f52aa38

Upload v2.0__hidream/README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. v2.0__hidream/README.md +147 -0
v2.0__hidream/README.md ADDED
@@ -0,0 +1,147 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ tags:
5
+ - art
6
+ ---
7
+
8
+ # Flat Color - Style
9
+
10
+ **Creator**: [motimalu](https://civitai.com/user/motimalu)
11
+ **Type**: LORA
12
+ **Base Model**: HiDream
13
+ **Version**: v2.0 [hidream]
14
+ **Trigger Words**: `flat color, no lineart`
15
+
16
+ **Civitai Model ID**: 1132089
17
+ **Civitai Version ID**: 1734377
18
+
19
+ **Stats (at time of fetch)**:
20
+ * Downloads: 1858
21
+ * Rating: 0 (0 ratings)
22
+ * Favorites: N/A
23
+
24
+ ---
25
+
26
+ ## 📄 Description (Parent Model)
27
+
28
+ Flat Color
29
+ -
30
+ Style
31
+ Trained on images without visible lineart, flat colors, and
32
+ little to no indication of depth.
33
+ ℹ️ LoRA work best when applied to the base models on which they are trained.
34
+ Please read the
35
+ About This Version
36
+ on the appropriate base models
37
+ and workflow/training information.
38
+ This is a small style LoRA I thought would be interesting to try with a v-pred model (noobai v-pred), for the reduced color bleeding and strong blacks in particular.
39
+ The effect is quite nice and easy to evaluate in training, so I've extended the dataset with videos in following versions for text-to-video models like Wan and Hunyuan, and it is what I am generally using to test LoRA training on new models now.
40
+ Recommended prompt structure:
41
+ Positive prompt:
42
+ flat color, no lineart, blending, negative space,
43
+ {{tags}}
44
+ masterpiece, best quality, very aesthetic, newest
45
+
46
+ ## Version Notes (v2.0 [hidream])
47
+
48
+ [HIDREAM] LoRA
49
+ Trained with
50
+ diffusion-pipe
51
+ on
52
+ HiDream-I1-Full
53
+ 1480 steps on a 4090 over ~7hrs
54
+ Previews generated with
55
+ ComfyUI_examples/hidream/#hidream-dev-workflow
56
+ Loading the LoRA with LoraLoaderModelOnly node and using the HiDream DEV fp8 model:
57
+ hidream_i1_dev_fp8.safetensors
58
+ config.toml
59
+ # Dataset config file.
60
+ output_dir = '/mnt/d/hidream/training_output'
61
+ dataset = 'dataset-hidream.toml'
62
+
63
+ # Training settings
64
+ epochs = 50
65
+ micro_batch_size_per_gpu = 1
66
+ pipeline_stages = 1
67
+ gradient_accumulation_steps = 4
68
+ gradient_clipping = 1.0
69
+ warmup_steps = 100
70
+ blocks_to_swap = 20
71
+
72
+ # eval settings
73
+ eval_every_n_epochs = 5
74
+ eval_before_first_step = true
75
+ eval_micro_batch_size_per_gpu = 1
76
+ eval_gradient_accumulation_steps = 1
77
+
78
+ # misc settings
79
+ save_every_n_epochs = 10
80
+ checkpoint_every_n_minutes = 30
81
+ activation_checkpointing = true
82
+ partition_method = 'parameters'
83
+ save_dtype = 'bfloat16'
84
+ caching_batch_size = 1
85
+ steps_per_print = 1
86
+ video_clip_mode = 'single_beginning'
87
+
88
+ [model]
89
+ type = 'hidream'
90
+ diffusers_path = '../hidream-full'
91
+ llama3_path = '../llama-3.1'
92
+ llama3_4bit = true
93
+ dtype = 'bfloat16'
94
+ transformer_dtype = 'nf4'
95
+ max_llama3_sequence_length = 256
96
+ flux_shift = true
97
+
98
+ [adapter]
99
+ type = 'lora'
100
+ rank = 32
101
+ dtype = 'bfloat16'
102
+
103
+ [optimizer]
104
+ type = 'adamw_optimi'
105
+ lr = 5e-5
106
+ betas = [0.9, 0.99]
107
+ weight_decay = 0.02
108
+ eps = 1e-8
109
+ dataset.toml
110
+ # Resolution settings.
111
+ resolutions = [1024]
112
+
113
+ # Aspect ratio bucketing settings
114
+ enable_ar_bucket = true
115
+ min_ar = 0.5
116
+ max_ar = 2.0
117
+ num_ar_buckets = 7
118
+
119
+ [[directory]] # IMAGES
120
+ # Path to the directory containing images and their corresponding caption files.
121
+ path = '/mnt/d/huanvideo/training_data/images'
122
+ num_repeats = 5
123
+ resolutions = [1024]
124
+
125
+ ---
126
+
127
+ ## Civitai Links
128
+
129
+ * **[🔗 View This Version on Civitai →](https://civitai.com/models/1132089?modelVersionId=1734377)**
130
+ * [View Full Model Page →](https://civitai.com/models/1132089)
131
+ * [View Creator Profile →](https://civitai.com/user/motimalu)
132
+
133
+ ---
134
+
135
+ ## Preview Images
136
+
137
+ ![Preview Image](./previews/1734377_73603487.jpeg)
138
+
139
+ ---
140
+
141
+ ## File Information
142
+
143
+ * **Filename**: `hidream_flat_color_v2.safetensors`
144
+ * **Size**: 562.56 MB
145
+ * **Hash (AutoV2)**: `75BBE3529E`
146
+ * **Hash (SHA256)**: `75BBE3529E6D26157956D65E789B609A070C37B9A28E1F1718AC9D57FD601967`
147
+