FlameF0X commited on
Commit
32a6cdd
·
verified ·
1 Parent(s): 22a4fbc

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. README.md +30 -0
  2. config.json +27 -0
  3. model.safetensors +3 -0
  4. scheduler/scheduler_config.json +19 -0
README.md CHANGED
@@ -1,3 +1,33 @@
1
  ---
 
 
 
 
 
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ tags:
3
+ - text-to-image
4
+ - diffusion
5
+ - latent-diffusion
6
+ - pytorch
7
  license: apache-2.0
8
  ---
9
+
10
+ # Mini Latent Diffusion Model
11
+
12
+ A ~46M parameter UNet trained from scratch for text-to-image generation
13
+ in latent space (SD VAE + CLIP text encoder, both frozen).
14
+
15
+ **Dataset:** [BitTranslate/Bittensor_subnet_19_06_04_24](https://huggingface.co/datasets/BitTranslate/Bittensor_subnet_19_06_04_24)
16
+ **Trained steps:** 500
17
+ **Image size:** 256px → 32×32 latents
18
+
19
+ ## Architecture
20
+
21
+ - **UNet base channels:** 128
22
+ - **Channel multipliers:** (1, 2, 3, 4)
23
+ - **Res blocks per level:** 2
24
+ - **Cross-attention (text conditioning):** latent res (8,)
25
+ - **VAE (frozen):** `runwayml/stable-diffusion-v1-5` vae subfolder
26
+ - **Text encoder (frozen):** CLIP ViT-L/14 from `runwayml/stable-diffusion-v1-5`
27
+
28
+ ## Inference
29
+
30
+ ```python
31
+ from train_mini_ldm import generate
32
+ imgs = generate("a sunset over the ocean", "./mini_ldm_output/final")
33
+ ```
config.json ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_model_type": "MiniUNet",
3
+ "in_channels": 4,
4
+ "model_channels": 128,
5
+ "channel_mults": [
6
+ 1,
7
+ 2,
8
+ 3,
9
+ 4
10
+ ],
11
+ "num_res_blocks": 2,
12
+ "attn_resolutions": [
13
+ 8
14
+ ],
15
+ "context_dim": 768,
16
+ "dataset": "BitTranslate/Bittensor_subnet_19_06_04_24",
17
+ "image_size": 256,
18
+ "num_train_timesteps": 1000,
19
+ "beta_schedule": "scaled_linear",
20
+ "trained_steps": 500,
21
+ "vae_id": "runwayml/stable-diffusion-v1-5",
22
+ "vae_subfolder": "vae",
23
+ "text_encoder_id": "runwayml/stable-diffusion-v1-5",
24
+ "text_encoder_subfolder": "text_encoder",
25
+ "tokenizer_id": "runwayml/stable-diffusion-v1-5",
26
+ "tokenizer_subfolder": "tokenizer"
27
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ea659a2e74cab259cf0b00737281940cf1ff3579437346d758f42a02be8c30f
3
+ size 182146728
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "DDPMScheduler",
3
+ "_diffusers_version": "0.38.0",
4
+ "beta_end": 0.02,
5
+ "beta_schedule": "scaled_linear",
6
+ "beta_start": 0.0001,
7
+ "clip_sample": true,
8
+ "clip_sample_range": 1.0,
9
+ "dynamic_thresholding_ratio": 0.995,
10
+ "num_train_timesteps": 1000,
11
+ "prediction_type": "epsilon",
12
+ "rescale_betas_zero_snr": false,
13
+ "sample_max_value": 1.0,
14
+ "steps_offset": 0,
15
+ "thresholding": false,
16
+ "timestep_spacing": "leading",
17
+ "trained_betas": null,
18
+ "variance_type": "fixed_small"
19
+ }