ZeroCool94 commited on
Commit
13e9a0b
·
1 Parent(s): 5329b65

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -9
README.md CHANGED
@@ -40,12 +40,10 @@ This model is still in its infancy and it's meant to be constantly updated and t
40
  - #### Stable:
41
  - No stable version available right now.
42
  - #### Beta:
43
- - [vae.2670000.pt](https://huggingface.co/Sygil/Sygil-Muse/blob/main/vae.2670000.pt): Trained from scratch for 2.67M steps
44
  - [maskgit.1206000.p](https://huggingface.co/Sygil/Sygil-Muse/blob/main/maskgit.1206000.pt): Maskgit trained from the VAE for 1.20M steps
45
 
46
- Note: Checkpoints under the Beta section are updated daily or at least 3-4 times a week. This is usually the equivalent of 1-2 training session,
47
- this is done until they are stable enough to be moved into a proper release, usually every 1 or 2 weeks.
48
- While the beta checkpoints can be used as they are only the latest version is kept on the repo and the older checkpoints are removed when a new one
49
  is uploaded to keep the repo clean.
50
 
51
  ## Training
@@ -55,16 +53,16 @@ The model was trained on the following dataset:
55
  - [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
56
 
57
  **Hardware and others**
58
- - **Hardware:** 1 x Nvidia RTX 3090 GPU
59
  - **Hours Trained:** NaN.
60
- - **Gradient Accumulations**: 1
61
  - **Batch:** 1
62
  - **Learning Rate:** 7e-08
63
  - **Warmup Steps:** 10,000
64
- - **Resolution/Image Size**: First trained at a resolution of 64x64 and then increased to 512x512. Check the notes down below for more details on this.
65
- - **Dimension:** 256
66
  - **vq_codebook_size:** 256
67
- - **Total Training Steps:** 2,670,000
68
 
69
  Note: On Muse we can change the image_size or resolution at any time without having to train the model from scratch again, this allows us to first train the model at low resolution using the same `dim` and `vq_codebook_size` to train faster and then we can increase the `image_size` and use a higher resolution once the model has trained enough.
70
 
 
40
  - #### Stable:
41
  - No stable version available right now.
42
  - #### Beta:
43
+ - [vae.2700500.pt](https://huggingface.co/Sygil/Sygil-Muse/blob/main/vae.2700500.pt): Trained from scratch for 2.70M steps
44
  - [maskgit.1206000.p](https://huggingface.co/Sygil/Sygil-Muse/blob/main/maskgit.1206000.pt): Maskgit trained from the VAE for 1.20M steps
45
 
46
+ Note: Checkpoints under the Beta section are updated daily or at least 3-4 times a week. While the beta checkpoints can be used as they are only the latest version is kept on the repo and the older checkpoints are removed when a new one
 
 
47
  is uploaded to keep the repo clean.
48
 
49
  ## Training
 
53
  - [Imaginary Network Expanded Dataset](https://github.com/Sygil-Dev/INE-dataset) dataset.
54
 
55
  **Hardware and others**
56
+ - **Hardware:** 1 x Nvidia RTX 3050 GPU
57
  - **Hours Trained:** NaN.
58
+ - **Gradient Accumulations**: 10
59
  - **Batch:** 1
60
  - **Learning Rate:** 7e-08
61
  - **Warmup Steps:** 10,000
62
+ - **Resolution/Image Size**: First trained at a resolution of 64x64, then increased to 256x256 and then to 512x512. Check the notes down below for more details on this.
63
+ - **Dimension:** 128
64
  - **vq_codebook_size:** 256
65
+ - **Total Training Steps:** 2,700,500
66
 
67
  Note: On Muse we can change the image_size or resolution at any time without having to train the model from scratch again, this allows us to first train the model at low resolution using the same `dim` and `vq_codebook_size` to train faster and then we can increase the `image_size` and use a higher resolution once the model has trained enough.
68