diegochavez commited on
Commit
017f265
·
verified ·
1 Parent(s): 991eaac

Upload folder using huggingface_hub

Browse files
Files changed (34) hide show
  1. .gitattributes +28 -0
  2. README.md +55 -0
  3. biomorphrx_krea_14B_1000.safetensors +3 -0
  4. biomorphrx_krea_14B_1250.safetensors +3 -0
  5. biomorphrx_krea_14B_1500.safetensors +3 -0
  6. config.yaml +128 -0
  7. samples/1776607189671__000000000_0.webp +3 -0
  8. samples/1776607445055__000000000_1.webp +3 -0
  9. samples/1776607700743__000000000_2.webp +3 -0
  10. samples/1776607955648__000000000_3.webp +3 -0
  11. samples/1776611063621__000000250_0.webp +3 -0
  12. samples/1776611320644__000000250_1.webp +3 -0
  13. samples/1776611577821__000000250_2.webp +3 -0
  14. samples/1776611834745__000000250_3.webp +3 -0
  15. samples/1776614932757__000000500_0.webp +3 -0
  16. samples/1776615190220__000000500_1.webp +3 -0
  17. samples/1776615447214__000000500_2.webp +3 -0
  18. samples/1776615704197__000000500_3.webp +3 -0
  19. samples/1776618888216__000000750_0.webp +3 -0
  20. samples/1776619145209__000000750_1.webp +3 -0
  21. samples/1776619402349__000000750_2.webp +3 -0
  22. samples/1776619659344__000000750_3.webp +3 -0
  23. samples/1776622769650__000001000_0.webp +3 -0
  24. samples/1776623026555__000001000_1.webp +3 -0
  25. samples/1776623283649__000001000_2.webp +3 -0
  26. samples/1776623540745__000001000_3.webp +3 -0
  27. samples/1776626588007__000001250_0.webp +3 -0
  28. samples/1776626845875__000001250_1.webp +3 -0
  29. samples/1776627103251__000001250_2.webp +3 -0
  30. samples/1776627359945__000001250_3.webp +3 -0
  31. samples/1776630520190__000001500_0.webp +3 -0
  32. samples/1776630776931__000001500_1.webp +3 -0
  33. samples/1776631033452__000001500_2.webp +3 -0
  34. samples/1776631290148__000001500_3.webp +3 -0
.gitattributes CHANGED
@@ -33,3 +33,31 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ samples/1776607189671__000000000_0.webp filter=lfs diff=lfs merge=lfs -text
37
+ samples/1776607445055__000000000_1.webp filter=lfs diff=lfs merge=lfs -text
38
+ samples/1776607700743__000000000_2.webp filter=lfs diff=lfs merge=lfs -text
39
+ samples/1776607955648__000000000_3.webp filter=lfs diff=lfs merge=lfs -text
40
+ samples/1776611063621__000000250_0.webp filter=lfs diff=lfs merge=lfs -text
41
+ samples/1776611320644__000000250_1.webp filter=lfs diff=lfs merge=lfs -text
42
+ samples/1776611577821__000000250_2.webp filter=lfs diff=lfs merge=lfs -text
43
+ samples/1776611834745__000000250_3.webp filter=lfs diff=lfs merge=lfs -text
44
+ samples/1776614932757__000000500_0.webp filter=lfs diff=lfs merge=lfs -text
45
+ samples/1776615190220__000000500_1.webp filter=lfs diff=lfs merge=lfs -text
46
+ samples/1776615447214__000000500_2.webp filter=lfs diff=lfs merge=lfs -text
47
+ samples/1776615704197__000000500_3.webp filter=lfs diff=lfs merge=lfs -text
48
+ samples/1776618888216__000000750_0.webp filter=lfs diff=lfs merge=lfs -text
49
+ samples/1776619145209__000000750_1.webp filter=lfs diff=lfs merge=lfs -text
50
+ samples/1776619402349__000000750_2.webp filter=lfs diff=lfs merge=lfs -text
51
+ samples/1776619659344__000000750_3.webp filter=lfs diff=lfs merge=lfs -text
52
+ samples/1776622769650__000001000_0.webp filter=lfs diff=lfs merge=lfs -text
53
+ samples/1776623026555__000001000_1.webp filter=lfs diff=lfs merge=lfs -text
54
+ samples/1776623283649__000001000_2.webp filter=lfs diff=lfs merge=lfs -text
55
+ samples/1776623540745__000001000_3.webp filter=lfs diff=lfs merge=lfs -text
56
+ samples/1776626588007__000001250_0.webp filter=lfs diff=lfs merge=lfs -text
57
+ samples/1776626845875__000001250_1.webp filter=lfs diff=lfs merge=lfs -text
58
+ samples/1776627103251__000001250_2.webp filter=lfs diff=lfs merge=lfs -text
59
+ samples/1776627359945__000001250_3.webp filter=lfs diff=lfs merge=lfs -text
60
+ samples/1776630520190__000001500_0.webp filter=lfs diff=lfs merge=lfs -text
61
+ samples/1776630776931__000001500_1.webp filter=lfs diff=lfs merge=lfs -text
62
+ samples/1776631033452__000001500_2.webp filter=lfs diff=lfs merge=lfs -text
63
+ samples/1776631290148__000001500_3.webp filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - lora
5
+ - wan2.1
6
+ - text-to-video
7
+ - krea-realtime
8
+ - daydream-scope
9
+ base_model: Wan-AI/Wan2.1-T2V-14B-Diffusers
10
+ ---
11
+
12
+ # biomorphrx — Krea Realtime 14B LoRA
13
+
14
+ Biomorphic / reaction-diffusion video LoRA trained on Wan 2.1 T2V **14B** for the Daydream Scope **Krea Realtime** pipeline.
15
+
16
+ **⚠️ Training in progress** — checkpoints 1000/1250/1500 uploaded early for testing. Final step 2000 will be added when training completes.
17
+
18
+ ## Trigger
19
+
20
+ `biomorphrx`
21
+
22
+ ## Files
23
+
24
+ | File | Step | Notes |
25
+ | --- | --- | --- |
26
+ | `biomorphrx_krea_14B_1500.safetensors` | 1500 | Mid-training — currently testing |
27
+ | `biomorphrx_krea_14B_1250.safetensors` | 1250 | Earlier checkpoint |
28
+ | `biomorphrx_krea_14B_1000.safetensors` | 1000 | Earlier checkpoint |
29
+ | `config.yaml` | — | ai-toolkit training config |
30
+ | `samples/` | 0–1500 | webp animations every 250 steps × 4 prompts |
31
+
32
+ ## Base model
33
+
34
+ [Wan-AI/Wan2.1-T2V-14B-Diffusers](https://huggingface.co/Wan-AI/Wan2.1-T2V-14B-Diffusers) — the 14B base that Daydream Scope's **Krea Realtime** pipeline distills from. **Not** compatible with LongLive (1.3B) pipelines — see [biomorphrx_longlive_1-3B](https://huggingface.co/diegochavez/biomorphrx_longlive_1-3B) for that variant.
35
+
36
+ ## Training
37
+
38
+ - **Dataset:** 53 images + 40 videos (720×480, 16 fps, 41 frames — 4k+1 Wan VAE rule)
39
+ - **Captions:** 100% unique, combinatorial (`FORM × COLOR × BACKGROUND × LIGHTING`), trigger word first
40
+ - **Steps:** 2000 (final), LoRA rank 32 / alpha 32
41
+ - **Optimizer:** adamw8bit, lr 1e-4, EMA 0.99, gradient accumulation 2
42
+ - **Quantization:** qfloat8 (transformer + text encoder)
43
+ - **Hardware:** RunPod A100 SXM 80GB, ~8-9 hr
44
+ - **Trainer:** [ostris/ai-toolkit](https://github.com/ostris/ai-toolkit)
45
+
46
+ ## Sample prompts
47
+
48
+ ```
49
+ biomorphrx iridescent macro bloom with cyan and magenta hues on black background, shallow depth of field
50
+ biomorphrx Belousov-Zhabotinsky reaction-diffusion pattern, teal and orange oscillations, slow swirling
51
+ biomorphrx organic slime mold growth spreading over dark substrate, time-lapse
52
+ biomorphrx radial cluster of cream petals with blue rim light on black, slow drift
53
+ ```
54
+
55
+ Native resolution: **720×480**. 41 frames at 16 fps for training; real-time rollout from Krea Realtime distillation.
biomorphrx_krea_14B_1000.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e5c9d262370ca2f9626fc4d832ed3603bf120ed83c09e3f3b087eb7205d6087
3
+ size 306808424
biomorphrx_krea_14B_1250.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e722a7acc83646cb3f332c61cb703016576096556fa0af2c0a11c0157690e1f7
3
+ size 306808424
biomorphrx_krea_14B_1500.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb1f00a938e1692d45a7813b3846f9b56776affba4ab7fa0fb035ac07bb1f018
3
+ size 306808424
config.yaml ADDED
@@ -0,0 +1,128 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ job: extension
2
+ config:
3
+ name: biomorphrx_krea
4
+ process:
5
+ - type: diffusion_trainer
6
+ training_folder: /workspace/ai-toolkit/output
7
+ sqlite_db_path: ./aitk_db.db
8
+ device: cuda
9
+ trigger_word: biomorphrx
10
+ performance_log_every: 10
11
+ network:
12
+ type: lora
13
+ linear: 32
14
+ linear_alpha: 32
15
+ network_kwargs:
16
+ ignore_if_contains: []
17
+ save:
18
+ dtype: bf16
19
+ save_every: 250
20
+ max_step_saves_to_keep: 4
21
+ save_format: safetensors
22
+ push_to_hub: false
23
+ datasets:
24
+ - folder_path: /workspace/ai-toolkit/datasets/biomorphrx/images
25
+ mask_path: null
26
+ mask_min_value: 0.1
27
+ default_caption: ''
28
+ caption_ext: txt
29
+ caption_dropout_rate: 0.05
30
+ cache_latents_to_disk: true
31
+ is_reg: false
32
+ network_weight: 1
33
+ resolution:
34
+ - 480
35
+ - 720
36
+ controls: []
37
+ shrink_video_to_frames: true
38
+ num_frames: 1
39
+ flip_x: false
40
+ flip_y: false
41
+ num_repeats: 1
42
+ - folder_path: /workspace/ai-toolkit/datasets/biomorphrx/videos_krea
43
+ mask_path: null
44
+ mask_min_value: 0.1
45
+ default_caption: ''
46
+ caption_ext: txt
47
+ caption_dropout_rate: 0.05
48
+ cache_latents_to_disk: true
49
+ is_reg: false
50
+ network_weight: 1
51
+ resolution:
52
+ - 480
53
+ - 720
54
+ controls: []
55
+ shrink_video_to_frames: true
56
+ num_frames: 41
57
+ flip_x: false
58
+ flip_y: false
59
+ num_repeats: 1
60
+ train:
61
+ batch_size: 1
62
+ bypass_guidance_embedding: false
63
+ steps: 2000
64
+ gradient_accumulation: 2
65
+ train_unet: true
66
+ train_text_encoder: false
67
+ gradient_checkpointing: true
68
+ noise_scheduler: flowmatch
69
+ optimizer: adamw8bit
70
+ timestep_type: sigmoid
71
+ content_or_style: balanced
72
+ optimizer_params:
73
+ weight_decay: 0.01
74
+ unload_text_encoder: true
75
+ cache_text_embeddings: false
76
+ lr: 0.0001
77
+ ema_config:
78
+ use_ema: true
79
+ ema_decay: 0.99
80
+ skip_first_sample: false
81
+ force_first_sample: false
82
+ disable_sampling: false
83
+ dtype: bf16
84
+ diff_output_preservation: false
85
+ diff_output_preservation_multiplier: 1
86
+ diff_output_preservation_class: person
87
+ switch_boundary_every: 1
88
+ loss_type: mse
89
+ logging:
90
+ log_every: 10
91
+ use_ui_logger: true
92
+ model:
93
+ name_or_path: Wan-AI/Wan2.1-T2V-14B-Diffusers
94
+ quantize: true
95
+ qtype: qfloat8
96
+ quantize_te: true
97
+ qtype_te: qfloat8
98
+ arch: wan21:14b
99
+ low_vram: false
100
+ model_kwargs: {}
101
+ sample:
102
+ sampler: flowmatch
103
+ sample_every: 250
104
+ width: 720
105
+ height: 480
106
+ samples:
107
+ - prompt: biomorphrx iridescent macro bloom with cyan and magenta hues on black
108
+ background, shallow depth of field
109
+ seed: 1
110
+ - prompt: biomorphrx Belousov-Zhabotinsky reaction-diffusion pattern, teal and
111
+ orange oscillations, slow swirling
112
+ seed: 2
113
+ - prompt: biomorphrx organic slime mold growth spreading over dark substrate,
114
+ time-lapse
115
+ seed: 3
116
+ - prompt: biomorphrx radial cluster of cream petals with blue rim light on black,
117
+ slow drift
118
+ seed: 4
119
+ neg: ''
120
+ seed: 42
121
+ walk_seed: true
122
+ guidance_scale: 5
123
+ sample_steps: 30
124
+ num_frames: 41
125
+ fps: 16
126
+ meta:
127
+ name: biomorphrx_krea
128
+ version: '1.0'
samples/1776607189671__000000000_0.webp ADDED

Git LFS Details

  • SHA256: 454b804759599a11170ceae0a8a7547c2b0b51c971ae329801dd6bda987bc7c9
  • Pointer size: 132 Bytes
  • Size of remote file: 1.95 MB
samples/1776607445055__000000000_1.webp ADDED

Git LFS Details

  • SHA256: a2bf0d7351db43ff43b4d0ce5f5097780cc70b8d8b9365bac14e5ddfe8440e7a
  • Pointer size: 132 Bytes
  • Size of remote file: 3.64 MB
samples/1776607700743__000000000_2.webp ADDED

Git LFS Details

  • SHA256: 63cac3a21701cb193cb343001546d328b0d9b54464a336b03196c4913b009b7a
  • Pointer size: 131 Bytes
  • Size of remote file: 709 kB
samples/1776607955648__000000000_3.webp ADDED

Git LFS Details

  • SHA256: 3ac40e82b8a33dd242bf00cb99119fe959c31c2db66065bb426cdb3daf33ee9b
  • Pointer size: 131 Bytes
  • Size of remote file: 372 kB
samples/1776611063621__000000250_0.webp ADDED

Git LFS Details

  • SHA256: f449a570aa72d7847179b8934b40f4d8bd565875d2cd06e64c64e67adf8aa9c7
  • Pointer size: 132 Bytes
  • Size of remote file: 1.41 MB
samples/1776611320644__000000250_1.webp ADDED

Git LFS Details

  • SHA256: 8fe9092a458683bfe9067f6f68369e1feabe26a034ec99a07241b00730b89cb1
  • Pointer size: 132 Bytes
  • Size of remote file: 2.64 MB
samples/1776611577821__000000250_2.webp ADDED

Git LFS Details

  • SHA256: f195988c4131ff0cdc875361e02a2124359a6a8000325c14664df1ceb7d5dc80
  • Pointer size: 131 Bytes
  • Size of remote file: 885 kB
samples/1776611834745__000000250_3.webp ADDED

Git LFS Details

  • SHA256: da1c0ae6f32794772dd1c345da1d18fba08a273a8dd81f729b3f8e9887cabab8
  • Pointer size: 131 Bytes
  • Size of remote file: 726 kB
samples/1776614932757__000000500_0.webp ADDED

Git LFS Details

  • SHA256: 786d54e074c4e4b7987670b5de3672bafe2bd51b6430449673762ba78252de32
  • Pointer size: 132 Bytes
  • Size of remote file: 1.04 MB
samples/1776615190220__000000500_1.webp ADDED

Git LFS Details

  • SHA256: b49fb4e34bf27517c20289bb5803708112f9a8bb10d0f5c0c5f02ea9a772c59b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.54 MB
samples/1776615447214__000000500_2.webp ADDED

Git LFS Details

  • SHA256: 1636c64a255c6cd39e807a6bebc71bcf9314536cf64c3fa0708ef5db19d8c12b
  • Pointer size: 131 Bytes
  • Size of remote file: 661 kB
samples/1776615704197__000000500_3.webp ADDED

Git LFS Details

  • SHA256: 412b2e18bcbc2d4ec34ed28080af7933369e5ec8b9f41702341b9d653f1e0db5
  • Pointer size: 131 Bytes
  • Size of remote file: 884 kB
samples/1776618888216__000000750_0.webp ADDED

Git LFS Details

  • SHA256: e26feebaa8065826101369500ee7b01e53c1a85af611fbed5c88f63442a3f0a4
  • Pointer size: 132 Bytes
  • Size of remote file: 1.07 MB
samples/1776619145209__000000750_1.webp ADDED

Git LFS Details

  • SHA256: e88e44a3f3a534a670e731e28cabc95ce722e0ce073d5c085bc07b9fc16654f5
  • Pointer size: 132 Bytes
  • Size of remote file: 1.45 MB
samples/1776619402349__000000750_2.webp ADDED

Git LFS Details

  • SHA256: 3ce841f82b657a03a4a0722a6c06ef0fca64ab91504822402de0759ccd4dc8b6
  • Pointer size: 131 Bytes
  • Size of remote file: 849 kB
samples/1776619659344__000000750_3.webp ADDED

Git LFS Details

  • SHA256: 89946feb59a4b263db72aab44aa3bd5ec014822fb99faeb95a074b1b103752bd
  • Pointer size: 131 Bytes
  • Size of remote file: 750 kB
samples/1776622769650__000001000_0.webp ADDED

Git LFS Details

  • SHA256: ce83c207543f0dc1f06f66a5b3bf670af85eeabfd03013a3f32b50ff528d98ce
  • Pointer size: 132 Bytes
  • Size of remote file: 1.03 MB
samples/1776623026555__000001000_1.webp ADDED

Git LFS Details

  • SHA256: 123f13489be470c593de450137b1f56d9a02b891face242a1b4fba69f69f58d5
  • Pointer size: 132 Bytes
  • Size of remote file: 1.41 MB
samples/1776623283649__000001000_2.webp ADDED

Git LFS Details

  • SHA256: 9570bbee4a58a4604c9d1b6b6f6adfa91940ff9adac5a16b4a07be00264d3754
  • Pointer size: 131 Bytes
  • Size of remote file: 822 kB
samples/1776623540745__000001000_3.webp ADDED

Git LFS Details

  • SHA256: ee034e1800e14db668d6e4a7312f6ab121c8eae895beae202eef4830cdfb281f
  • Pointer size: 131 Bytes
  • Size of remote file: 837 kB
samples/1776626588007__000001250_0.webp ADDED

Git LFS Details

  • SHA256: 392f34fea29b24a6bf3b793e0f1d4ff8e13bfe5995a9bba2a69edbe08fd1ecf7
  • Pointer size: 131 Bytes
  • Size of remote file: 850 kB
samples/1776626845875__000001250_1.webp ADDED

Git LFS Details

  • SHA256: ab75ea30954ba11016860eff16dbba8ff11fbaa6e9efc365952fded64bae85ad
  • Pointer size: 132 Bytes
  • Size of remote file: 1.54 MB
samples/1776627103251__000001250_2.webp ADDED

Git LFS Details

  • SHA256: d31fa72a5052275b7b961ab64b0dd0f8e6860162fe16e788ffbdcb65f5663402
  • Pointer size: 131 Bytes
  • Size of remote file: 796 kB
samples/1776627359945__000001250_3.webp ADDED

Git LFS Details

  • SHA256: ae6634034eb0c41d97e326731b438bbdb424a30354d42363d65a9cd8a662aeb7
  • Pointer size: 131 Bytes
  • Size of remote file: 618 kB
samples/1776630520190__000001500_0.webp ADDED

Git LFS Details

  • SHA256: d5563c3fbf671fbecb03941123f9a0e836e709e85ce390600f5fa5bed3ce0ebc
  • Pointer size: 131 Bytes
  • Size of remote file: 976 kB
samples/1776630776931__000001500_1.webp ADDED

Git LFS Details

  • SHA256: 731d870665bc4600361930ade149ccad5a129e3fcf5b2b30b65d7cca973bf158
  • Pointer size: 132 Bytes
  • Size of remote file: 1.74 MB
samples/1776631033452__000001500_2.webp ADDED

Git LFS Details

  • SHA256: f2c251430e6b35e8185461e74969f956048f7d07bb0049e9d0d68be9aceabe03
  • Pointer size: 131 Bytes
  • Size of remote file: 782 kB
samples/1776631290148__000001500_3.webp ADDED

Git LFS Details

  • SHA256: 63e535b57704fe370f76695b6bbff4259030a706349723d4542405884c158be8
  • Pointer size: 131 Bytes
  • Size of remote file: 357 kB