SD2704 commited on
Commit
38128fa
·
verified ·
1 Parent(s): 93571cf

Add comprehensive model card for training compatibility

Browse files
Files changed (1) hide show
  1. README.md +117 -0
README.md ADDED
@@ -0,0 +1,117 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ library_name: diffusers
4
+ pipeline_tag: text-to-image
5
+ tags:
6
+ - flux
7
+ - flux-dev
8
+ - text-to-image
9
+ - diffusers
10
+ - safetensors
11
+ - stable-diffusion
12
+ - image-generation
13
+ base_model: black-forest-labs/FLUX.1-dev
14
+ ---
15
+
16
+ # Real Dream Flux V1 V4 (RDV4)
17
+
18
+ A fine-tuned FLUX.1-dev transformer model optimized for high-quality image generation with improved realism and detail.
19
+
20
+ ## Model Description
21
+
22
+ **Real Dream Flux V1 V4** is a specialized version of FLUX.1-dev trained to produce photorealistic and detailed imagery. This model contains the transformer component in safetensors format, making it compatible with various training and inference tools including Ostris AI Toolkit.
23
+
24
+ ### Model Details
25
+
26
+ - **Model Type:** FLUX Transformer (FluxTransformer2DModel)
27
+ - **Base Model:** black-forest-labs/FLUX.1-dev
28
+ - **Format:** safetensors (15.91 GB)
29
+ - **Architecture:**
30
+ - 19 dual attention layers
31
+ - 38 single attention layers
32
+ - 24 attention heads with 128 dims per head
33
+ - Joint attention dimension: 4096
34
+
35
+ ## Usage
36
+
37
+ ### With Diffusers
38
+
39
+ ```python
40
+ from diffusers import FluxPipeline, FluxTransformer2DModel
41
+ import torch
42
+
43
+ # Load the custom transformer
44
+ transformer = FluxTransformer2DModel.from_pretrained(
45
+ "SD2704/RDV4",
46
+ subfolder="",
47
+ torch_dtype=torch.bfloat16
48
+ )
49
+
50
+ # Create pipeline with custom transformer
51
+ pipe = FluxPipeline.from_pretrained(
52
+ "black-forest-labs/FLUX.1-dev",
53
+ transformer=transformer,
54
+ torch_dtype=torch.bfloat16
55
+ )
56
+ pipe.to("cuda")
57
+
58
+ prompt = "your prompt here"
59
+ image = pipe(prompt, num_inference_steps=50, guidance_scale=3.5).images[0]
60
+ image.save("output.png")
61
+ ```
62
+
63
+ ### For Training with Ostris AI Toolkit
64
+
65
+ This model is fully compatible with Ostris AI Toolkit GUI for fine-tuning and LoRA training:
66
+
67
+ 1. In Ostris AI Toolkit, select "Load Model from Hugging Face"
68
+ 2. Enter model ID: `SD2704/RDV4`
69
+ 3. The toolkit will automatically download the transformer and config
70
+ 4. Configure your training parameters and dataset
71
+ 5. Start training!
72
+
73
+ ### Training Configuration
74
+
75
+ Recommended settings for fine-tuning:
76
+ - Learning rate: 1e-5 to 5e-6
77
+ - Batch size: 1-2 (depending on VRAM)
78
+ - Gradient accumulation: 4-8 steps
79
+ - Mixed precision: bf16
80
+ - Optimizer: AdamW or AdamW8bit
81
+
82
+ ## Training Data
83
+
84
+ This model was trained on curated datasets focusing on photorealistic imagery and detailed compositions.
85
+
86
+ ## Intended Use
87
+
88
+ - High-quality image generation
89
+ - Fine-tuning for specialized domains
90
+ - LoRA training for style adaptation
91
+ - Research and creative applications
92
+
93
+ ## Limitations
94
+
95
+ - Requires significant VRAM for inference (minimum 16GB recommended)
96
+ - Based on FLUX.1-dev architecture limitations
97
+ - May require prompt engineering for optimal results
98
+
99
+ ## License
100
+
101
+ This model follows the FLUX.1-dev licensing terms. Please refer to the base model license for usage restrictions.
102
+
103
+ ## Citation
104
+
105
+ ```
106
+ @misc{rdv4,
107
+ author = {SD2704},
108
+ title = {Real Dream Flux V1 V4},
109
+ year = {2024},
110
+ publisher = {HuggingFace},
111
+ url = {https://huggingface.co/SD2704/RDV4}
112
+ }
113
+ ```
114
+
115
+ ## Acknowledgments
116
+
117
+ Based on [FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev) by Black Forest Labs.