Update README.md

README.md

@@ -1,3 +1,73 @@
----
-license: mit
----
+---
+tags:
+- flux
+- text-to-image
+- iclora
+- diffusers
+- fal
+widget:
+  - text: "an intricately designed perfume bottle resting on a vintage carved dressing table, flanked by elegant makeup and jewelry, with a gilded mirror above and a vase of peonies adding a romantic ambiance, all depicted in a refined vintage style."
+    output:
+      url: pictures/t2i_1.png
+  - text: "A lively image featuring a bottle of alcopop on a sleek bar counter, a bokeh effect of an enthusiastic crowd and a live band with colorful stage lighting in the background, all wrapped up in a vivid urban nightlife ambiance"
+    output:
+      url: pictures/t2i_2.png
+  - text: "A luxurious crossbody bag is the centerpiece on a glass shelf, with a selection of high-end accessories neatly arrayed behind it, all bathed in a soft, diffused sunlight that adds a serene and exquisite touch to the image."
+    output:
+      url: pictures/t2i_3.png
+  - text: "The table is placed in an outdoor camping scene with a teapot and two teacups on the table, grass, outdoor, sunlight, HD, product photography."
+    output:
+      url: pictures/t2i_4.png
+  - text: "A bottle is placed in water, the water covers half of the product, the splash flies, the bottom half of the product placed under the water is clearly visible, waterproof advertising, product advertising, photography, HD, real, 8k"
+    output:
+      url: pictures/t2i_5.png
+  - text: "A photo of a serene landscape with a calm lake reflecting the surrounding mountains and forests. The mountains have a mix of tree and exposed rock. The sky is overcast, with dark clouds covering the sky. The reflection of the mountains and sky on the lake is mirror-clear. The shoreline is lined with trees. The ground is covered with grass."
+    output:
+      url: pictures/t2i_6.png
+      
+base_model: black-forest-labs/FLUX.1-dev
+license: other
+license_name: flux-1-dev-non-commercial-license
+license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
+---
+# Color-Patette-Flux_dev
+## Inference
+<Gallery />
+
+```python
+
+import torch
+import cv2
+from PIL import Image
+import numpy as np
+from diffusers.utils import load_image
+from diffusers.pipelines.flux.pipeline_flux_controlnet import FluxControlNetPipeline
+from diffusers.models.controlnet_flux import FluxControlNetModel
+
+controlnet_model_path = './flux_controlnet_artistic_text'
+controlnet = FluxControlNetModel.from_pretrained(controlnet_model, torch_dtype=torch.bfloat16)
+pipe = FluxControlNetPipeline.from_pretrained('black-forest-labs/FLUX.1-dev',
+                                              controlnet=controlnet,
+                                              torch_dtype=torch.bfloat16).to("cuda")
+
+
+font_mask_pil = Image.open(font_mask_path)
+font_mask_npy = np.array(font_mask_pil)
+if len(font_mask_npy.shape) == 2:
+   font_mask_npy = cv2.cvtColor(font_mask_npy, cv2.COLOR_GRAY2RGB)
+   font_mask_pil = Image.fromarray(font_mask_npy)
+
+prompt = "Vibrant, multicolored lettering against a soft, pastel background, with the letters appearing to be made of delicate petals and blooming flowers, giving a sense of freshness and natural beauty. The texture should mimic the intricate layers and velvety surfaces of various blossoms, with subtle gradients and occasional dewdrops enhancing the lifelike appearance."
+image = pipe(prompt,
+             control_image=font_mask_pil,
+             controlnet_conditioning_scale=0.6,
+             num_inference_steps=30,
+             guidance_scale=3.5,
+             generator=torch.Generator("cuda").manual_seed(42)).images[0]
+image.save("./result.png")
+```
+
+
+# Training
+
+Training was done using https://github.com/huggingface/diffusers/blob/main/examples/controlnet/train_controlnet_flux.py