linoyts HF Staff commited on
Commit
3032d53
·
verified ·
1 Parent(s): fa20396

Add FLUX.3 tarot LoRA sweep + model card

Browse files
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ images/carver.jpg filter=lfs diff=lfs merge=lfs -text
37
+ images/explorer.jpg filter=lfs diff=lfs merge=lfs -text
38
+ images/glutton.jpg filter=lfs diff=lfs merge=lfs -text
39
+ images/speaker.jpg filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,74 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: black-forest-labs/flux-3-image-klein-base
3
+ library_name: diffusers
4
+ license: other
5
+ tags:
6
+ - flux3
7
+ - lora
8
+ - diffusers
9
+ - text-to-image
10
+ - tarot
11
+ instance_prompt: a trtcrd, tarot style
12
+ widget:
13
+ - text: a trtcrd of a person giving a talk on a stage under a glowing emblem, tarot style
14
+ output:
15
+ url: images/speaker.jpg
16
+ - text: a trtcrd of a man carving meat from a Döner rotisserie, tarot style
17
+ output:
18
+ url: images/carver.jpg
19
+ - text: a trtcrd of a dog eating a big bowl of spaghetti at a dinner table, tarot style
20
+ output:
21
+ url: images/glutton.jpg
22
+ - text: a trtcrd of an astronaut planting a flag on a tiny planet among stars, tarot style
23
+ output:
24
+ url: images/explorer.jpg
25
+ ---
26
+
27
+ # FLUX.3 Tarot LoRA
28
+
29
+ A Rider-Waite tarot-style DreamBooth LoRA for the **FLUX.3 image (klein) model**, trained with the diffusers DreamBooth FLUX.3 trainer. Trigger the style with **`trtcrd`**, e.g. `"a trtcrd of ..., tarot style"`.
30
+
31
+ <Gallery />
32
+
33
+ ## Inference
34
+
35
+ ```python
36
+ import torch
37
+ from diffusers.modular_pipelines import Flux3AutoBlocks
38
+
39
+ pipe = Flux3AutoBlocks().init_pipeline("black-forest-labs/flux-3-image-klein-base")
40
+ pipe.load_components(dtype=torch.bfloat16)
41
+ pipe.to("cuda")
42
+ pipe.load_lora_weights("diffusers-modular/flux3-tarot-lora", weight_name="pytorch_lora_weights.safetensors")
43
+
44
+ image = pipe(
45
+ prompt="a trtcrd of a dog eating a big bowl of spaghetti, tarot style",
46
+ height=1344, width=800, num_inference_steps=28, negative_prompt="",
47
+ max_sequence_length=512, text_encoder_out_layers=(4, 8, 12, 16, 20, 24, 28, 32),
48
+ output="images",
49
+ )[0]
50
+ image.save("tarot.png")
51
+ ```
52
+
53
+ ## Trigger
54
+
55
+ Use `trtcrd` in the prompt: `"a trtcrd of {your subject}, tarot style"`.
56
+
57
+ ## Training
58
+
59
+ - Base model: `black-forest-labs/flux-3-image-klein-base`
60
+ - Dataset: [multimodalart/1920-raider-waite-tarot-public-domain](https://huggingface.co/datasets/multimodalart/1920-raider-waite-tarot-public-domain)
61
+ - 1500 steps · seed 0 · resolution 1024 · aspect-ratio buckets
62
+ - Default weights (`pytorch_lora_weights.safetensors`): AdamW (8-bit), rank 16, lr 1e-4
63
+
64
+ ### Sweep variants
65
+
66
+ This repo also includes the configs from a small sweep (one setting changed vs the default). Load one with `weight_name="<folder>/pytorch_lora_weights.safetensors"`:
67
+
68
+ | variant | change | `weight_name` |
69
+ |---|---|---|
70
+ | default | AdamW, rank 16 | `pytorch_lora_weights.safetensors` |
71
+ | rank 8 | rank → 8 | `rank8/pytorch_lora_weights.safetensors` |
72
+ | rank 32 | rank → 32 | `rank32/pytorch_lora_weights.safetensors` |
73
+ | more layers | + modulation layers | `more-layers/pytorch_lora_weights.safetensors` |
74
+ | prodigy | Prodigy optimizer, lr 1 | `prodigy/pytorch_lora_weights.safetensors` |
images/carver.jpg ADDED

Git LFS Details

  • SHA256: cea860ccd01f6ef9db818210614919aaae6444b92e45e4e08911ce3ac7d8271c
  • Pointer size: 131 Bytes
  • Size of remote file: 208 kB
images/explorer.jpg ADDED

Git LFS Details

  • SHA256: 1b324899dec23818c30bea6bb91c0485fa74172bd94ba0a08e9592908b91758b
  • Pointer size: 131 Bytes
  • Size of remote file: 150 kB
images/glutton.jpg ADDED

Git LFS Details

  • SHA256: 4eb7f96c311fb7e7e96454807e33dd5ca2c9a614b7b80ae3708faf9193f8b0b5
  • Pointer size: 131 Bytes
  • Size of remote file: 218 kB
images/speaker.jpg ADDED

Git LFS Details

  • SHA256: ab9350285e6eabeb81da8157bd703fed96d3c9db84b195abd14e50c711ae59d7
  • Pointer size: 131 Bytes
  • Size of remote file: 144 kB
more-layers/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c058053ba8905099baaad607cf6ab81dcec7884c29a51b6c00531127f0951bf
3
+ size 83042104
prodigy/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d3acd1a38b07ef392aeb3679ee86c2cae71c5053cfba01f0d0dfa153f4a9bf1
3
+ size 80385992
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5adac5ac7232708c2b3b55b1bb7a69c06c0c3e929f96073b7c5c7f3722c946a
3
+ size 80385992
rank32/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3228843ee5ef04289fb080dc80ad184a225998d6e5616c134dd917511105cd9
3
+ size 160700824
rank8/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2cac1cba84db5e0a26116bac30c43559321818bc145a52b765a0fda6cb9b685b
3
+ size 40228152