mally-2000 commited on
Commit
c3aab43
·
verified ·
1 Parent(s): 2b0a0ce

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. README.md +4 -3
  2. stage2_ldm.ckpt +2 -2
  3. stage2_ldm_config.yaml +104 -0
README.md CHANGED
@@ -9,9 +9,10 @@ For the Diffusers-format release with bundled inference code, see
9
  | File | Description |
10
  | --- | --- |
11
  | `stage1_vqgan.ckpt` | Stage 1 VQGAN checkpoint (first stage autoencoder). |
12
- | `stage2_ldm.ckpt` | Stage 2 latent diffusion / CLDM checkpoint. |
 
13
  | `ldm_backend_vqgan_marmousi.yaml` | Stage 1 training config. |
14
- | `ldm_backend_a101_train_hwd.yaml` | Stage 2 training config. |
15
  | `ldm_backend_lightning.yaml` | Lightning trainer, logger, and Overthrust eval callback config. |
16
 
17
  ## Usage
@@ -21,7 +22,7 @@ Clone the training code repository and copy these checkpoints/configs into it
21
 
22
  ```bash
23
  cp stage1_vqgan.ckpt stage2_ldm.ckpt <your_repo>/models/
24
- cp *.yaml <your_repo>/configs/
25
  ```
26
 
27
  Then set in `.env`:
 
9
  | File | Description |
10
  | --- | --- |
11
  | `stage1_vqgan.ckpt` | Stage 1 VQGAN checkpoint (first stage autoencoder). |
12
+ | `stage2_ldm.ckpt` | Stage 2 latent diffusion / CLDM checkpoint (original A101 run, epoch 212 / step 13,991). |
13
+ | `stage2_ldm_config.yaml` | Exact Stage 2 training config used for `stage2_ldm.ckpt`, with env-based paths. |
14
  | `ldm_backend_vqgan_marmousi.yaml` | Stage 1 training config. |
15
+ | `ldm_backend_a101_train_hwd.yaml` | Stage 2 training config from the refactored repo. |
16
  | `ldm_backend_lightning.yaml` | Lightning trainer, logger, and Overthrust eval callback config. |
17
 
18
  ## Usage
 
22
 
23
  ```bash
24
  cp stage1_vqgan.ckpt stage2_ldm.ckpt <your_repo>/models/
25
+ cp stage2_ldm_config.yaml <your_repo>/configs/
26
  ```
27
 
28
  Then set in `.env`:
stage2_ldm.ckpt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8f4af7c914246c9ee86c9dbb501eeed54b3b057d0674dc9a23a5fa1e61007fb3
3
- size 4606897830
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ed163c70c1950ee448248410cc2a5a80c7fe9790b29d372cf467ef06ac8ad74
3
+ size 4606892027
stage2_ldm_config.yaml ADDED
@@ -0,0 +1,104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ model:
2
+ base_learning_rate: 2.0e-06
3
+ target: ldm.models.diffusion.ddpm.LatentDiffusion
4
+ params:
5
+ linear_start: 0.0015
6
+ linear_end: 0.0195
7
+ num_timesteps_cond: 1
8
+ log_every_t: 200
9
+ timesteps: 1000
10
+ cond_drop: 1.0
11
+ first_stage_key: image
12
+ use_first_stage_cond:
13
+ - dipin
14
+ cond_stage_key:
15
+ - dipin
16
+ - record
17
+ cond_stage_trainable: false
18
+ conditioning_key: concat
19
+ concat_mode: true
20
+ image_size: 64
21
+ channels: 1
22
+ monitor: train/loss_simple_epoch
23
+ monitor_mode: min
24
+ monitor_top_k: 3
25
+ dynamic_size: false
26
+ unet_config:
27
+ target: ldm.modules.diffusionmodules.openaimodel.UNetModel
28
+ params:
29
+ in_channels: 6
30
+ out_channels: 1
31
+ model_channels: 224
32
+ attention_resolutions:
33
+ - 8
34
+ - 4
35
+ - 2
36
+ num_res_blocks: 2
37
+ channel_mult:
38
+ - 1
39
+ - 2
40
+ - 3
41
+ - 4
42
+ num_head_channels: 32
43
+ first_stage_config:
44
+ target: ldm.models.autoencoder.VQModelInterface
45
+ params:
46
+ ckpt_path: ${oc.env:FIRST_STAGE_CKPT,./models/stage1_vqgan.ckpt}
47
+ embed_dim: 1
48
+ n_embed: 32768
49
+ ddconfig:
50
+ double_z: false
51
+ z_channels: 3
52
+ resolution: 256
53
+ in_channels: 1
54
+ out_ch: 1
55
+ ch: 128
56
+ ch_mult:
57
+ - 1
58
+ - 2
59
+ - 4
60
+ num_res_blocks: 2
61
+ attn_resolutions: []
62
+ dropout: 0
63
+ lossconfig:
64
+ target: torch.nn.Identity
65
+ cond_stage_config:
66
+ target: ldm.modules.encoders.C2f_CGuidedBlock.HWD_down4
67
+ params:
68
+ in_c: 1
69
+ channels: 4
70
+ out_c: 4
71
+ wave: haar
72
+ mode: reflect
73
+ data:
74
+ target: main.DataModuleFromConfig
75
+ params:
76
+ batch_size: 24
77
+ num_workers: 1
78
+ wrap: false
79
+ train:
80
+ target: ldm.data.seisimic.Marmousi3_256
81
+ params:
82
+ dt_path: ${oc.env:MARMousi_NPZ,./data/dtA89-1.npz}
83
+ size: 256
84
+ normalize: minmax
85
+ ricks:
86
+ - 25
87
+ - 30
88
+ - 35
89
+ noise_snr:
90
+ - 20
91
+ dipins:
92
+ - 0.006
93
+ - 0.012
94
+ - 0.024
95
+ - 0.036
96
+ ricks_phase:
97
+ - 0
98
+ train_keys:
99
+ - image
100
+ - dipin
101
+ - record
102
+ noise_type: guassian_band
103
+ zhengyan_type: nonlinear
104
+ record_noraml: true