Text-to-Image
Diffusers
TensorBoard
Safetensors
stable-diffusion
stable-diffusion-diffusers
custom-diffusion
Instructions to use SidXXD/336 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SidXXD/336 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SidXXD/336", dtype=torch.bfloat16, device_map="cuda") prompt = "photo of a sks person" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Draw Things
- DiffusionBee
End of training
Browse files- README.md +22 -0
- checkpoint-250/custom_checkpoint_0.pkl +3 -0
- checkpoint-250/model.safetensors +3 -0
- checkpoint-250/model_1.safetensors +3 -0
- checkpoint-250/optimizer.bin +3 -0
- checkpoint-250/random_states_0.pkl +3 -0
- checkpoint-250/scheduler.bin +3 -0
- concepts_list.json +1 -0
- logs/custom-diffusion/1776760580.025223/events.out.tfevents.1776760580.cudahpc06.1354777.1 +3 -0
- logs/custom-diffusion/1776760580.0289042/hparams.yml +57 -0
- logs/custom-diffusion/1776761461.7933857/events.out.tfevents.1776761461.cudahpc06.1609186.1 +3 -0
- logs/custom-diffusion/1776761461.7972314/hparams.yml +57 -0
- logs/custom-diffusion/events.out.tfevents.1776760580.cudahpc06.1354777.0 +3 -0
- logs/custom-diffusion/events.out.tfevents.1776761461.cudahpc06.1609186.0 +3 -0
- pytorch_custom_diffusion_weights.bin +3 -0
- sks.bin +3 -0
README.md
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
---
|
| 3 |
+
license: creativeml-openrail-m
|
| 4 |
+
base_model: runwayml/stable-diffusion-v1-5
|
| 5 |
+
instance_prompt: photo of a sks person
|
| 6 |
+
tags:
|
| 7 |
+
- stable-diffusion
|
| 8 |
+
- stable-diffusion-diffusers
|
| 9 |
+
- text-to-image
|
| 10 |
+
- diffusers
|
| 11 |
+
- custom-diffusion
|
| 12 |
+
inference: true
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# Custom Diffusion - SidXXD/336
|
| 16 |
+
|
| 17 |
+
These are Custom Diffusion adaption weights for runwayml/stable-diffusion-v1-5. The weights were trained on photo of a sks person using [Custom Diffusion](https://www.cs.cmu.edu/~custom-diffusion). You can find some example images in the following.
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
|
| 21 |
+
|
| 22 |
+
For more details on the training, please follow [this link](https://github.com/huggingface/diffusers/blob/main/examples/custom_diffusion).
|
checkpoint-250/custom_checkpoint_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5fa4b68d23389874ecc603e8a6aa2bf501d22ca66a9cb99f4441deb804462f9f
|
| 3 |
+
size 76689565
|
checkpoint-250/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:af7f7989ededf0cc52589e7dbb7bf2c42b8494599aacc3c6b2f64ddbdaf3ff50
|
| 3 |
+
size 76682360
|
checkpoint-250/model_1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bd61c5fcfc18cbea87e34523450596e93adfbbf31bb0d64ec409b35f7e773cfe
|
| 3 |
+
size 492268240
|
checkpoint-250/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4cd5e10c15b5c166928b85e600d39793a342cb6269bf99de1ebd83ad058b075
|
| 3 |
+
size 456950854
|
checkpoint-250/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c6eb5ec820400e1f43f1dd79aeea0f24e2ca290b76bf91d8dac2834d6a29c839
|
| 3 |
+
size 14727
|
checkpoint-250/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c54c7dfa0981e4f3405702dde32f7c139b056257f5c201760ea6fbfb47a4b1d7
|
| 3 |
+
size 563
|
concepts_list.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
[{"instance_prompt": "photo of a sks person", "class_prompt": null, "instance_data_dir": "/data/144-1/users/xide/Code/HAAD/outputs/1-for_demo/4-faces/250/336", "class_data_dir": null}]
|
logs/custom-diffusion/1776760580.025223/events.out.tfevents.1776760580.cudahpc06.1354777.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e0b27d578b5dab4a52c514024f21313adc4930f06989d3025caa1b2fb978b50b
|
| 3 |
+
size 2715
|
logs/custom-diffusion/1776760580.0289042/hparams.yml
ADDED
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.01
|
| 5 |
+
allow_tf32: false
|
| 6 |
+
center_crop: false
|
| 7 |
+
checkpointing_steps: 250
|
| 8 |
+
checkpoints_total_limit: null
|
| 9 |
+
class_data_dir: null
|
| 10 |
+
class_prompt: null
|
| 11 |
+
concepts_list: null
|
| 12 |
+
dataloader_num_workers: 2
|
| 13 |
+
enable_xformers_memory_efficient_attention: false
|
| 14 |
+
freeze_model: crossattn_kv
|
| 15 |
+
gradient_accumulation_steps: 1
|
| 16 |
+
gradient_checkpointing: false
|
| 17 |
+
hflip: true
|
| 18 |
+
hub_model_id: null
|
| 19 |
+
hub_token: null
|
| 20 |
+
initializer_token: ktn
|
| 21 |
+
instance_data_dir: /data/144-1/users/xide/Code/HAAD/outputs/1-for_demo/4-faces/250/336
|
| 22 |
+
instance_prompt: photo of a sks person
|
| 23 |
+
learning_rate: 1.0e-05
|
| 24 |
+
local_rank: -1
|
| 25 |
+
logging_dir: logs
|
| 26 |
+
lr_scheduler: constant
|
| 27 |
+
lr_warmup_steps: 0
|
| 28 |
+
max_grad_norm: 1.0
|
| 29 |
+
max_train_steps: 250
|
| 30 |
+
mixed_precision: null
|
| 31 |
+
modifier_token: sks
|
| 32 |
+
no_safe_serialization: true
|
| 33 |
+
noaug: false
|
| 34 |
+
num_class_images: 200
|
| 35 |
+
num_train_epochs: 1
|
| 36 |
+
num_validation_images: 2
|
| 37 |
+
output_dir: /data/144-1/users/xide/Code/custom_diffusion/results/model/336
|
| 38 |
+
pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
|
| 39 |
+
prior_generation_precision: null
|
| 40 |
+
prior_loss_weight: 0
|
| 41 |
+
push_to_hub: true
|
| 42 |
+
real_prior: false
|
| 43 |
+
report_to: tensorboard
|
| 44 |
+
resolution: 512
|
| 45 |
+
resume_from_checkpoint: null
|
| 46 |
+
revision: null
|
| 47 |
+
sample_batch_size: 4
|
| 48 |
+
scale_lr: true
|
| 49 |
+
seed: 42
|
| 50 |
+
set_grads_to_none: false
|
| 51 |
+
tokenizer_name: null
|
| 52 |
+
train_batch_size: 2
|
| 53 |
+
use_8bit_adam: false
|
| 54 |
+
validation_prompt: null
|
| 55 |
+
validation_steps: 50
|
| 56 |
+
variant: null
|
| 57 |
+
with_prior_preservation: false
|
logs/custom-diffusion/1776761461.7933857/events.out.tfevents.1776761461.cudahpc06.1609186.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2597d1543f4fb0e6044171e2b194d0dffdafac055a7c009cd2f783a9599492c
|
| 3 |
+
size 2715
|
logs/custom-diffusion/1776761461.7972314/hparams.yml
ADDED
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.01
|
| 5 |
+
allow_tf32: false
|
| 6 |
+
center_crop: false
|
| 7 |
+
checkpointing_steps: 250
|
| 8 |
+
checkpoints_total_limit: null
|
| 9 |
+
class_data_dir: null
|
| 10 |
+
class_prompt: null
|
| 11 |
+
concepts_list: null
|
| 12 |
+
dataloader_num_workers: 2
|
| 13 |
+
enable_xformers_memory_efficient_attention: false
|
| 14 |
+
freeze_model: crossattn_kv
|
| 15 |
+
gradient_accumulation_steps: 1
|
| 16 |
+
gradient_checkpointing: false
|
| 17 |
+
hflip: true
|
| 18 |
+
hub_model_id: null
|
| 19 |
+
hub_token: null
|
| 20 |
+
initializer_token: ktn
|
| 21 |
+
instance_data_dir: /data/144-1/users/xide/Code/HAAD/outputs/1-for_demo/4-faces/250/336
|
| 22 |
+
instance_prompt: photo of a sks person
|
| 23 |
+
learning_rate: 1.0e-05
|
| 24 |
+
local_rank: -1
|
| 25 |
+
logging_dir: logs
|
| 26 |
+
lr_scheduler: constant
|
| 27 |
+
lr_warmup_steps: 0
|
| 28 |
+
max_grad_norm: 1.0
|
| 29 |
+
max_train_steps: 250
|
| 30 |
+
mixed_precision: null
|
| 31 |
+
modifier_token: sks
|
| 32 |
+
no_safe_serialization: true
|
| 33 |
+
noaug: false
|
| 34 |
+
num_class_images: 200
|
| 35 |
+
num_train_epochs: 1
|
| 36 |
+
num_validation_images: 2
|
| 37 |
+
output_dir: /data/144-1/users/xide/Code/custom_diffusion/results/model/336
|
| 38 |
+
pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
|
| 39 |
+
prior_generation_precision: null
|
| 40 |
+
prior_loss_weight: 0
|
| 41 |
+
push_to_hub: true
|
| 42 |
+
real_prior: false
|
| 43 |
+
report_to: tensorboard
|
| 44 |
+
resolution: 512
|
| 45 |
+
resume_from_checkpoint: null
|
| 46 |
+
revision: null
|
| 47 |
+
sample_batch_size: 4
|
| 48 |
+
scale_lr: true
|
| 49 |
+
seed: 42
|
| 50 |
+
set_grads_to_none: false
|
| 51 |
+
tokenizer_name: null
|
| 52 |
+
train_batch_size: 2
|
| 53 |
+
use_8bit_adam: false
|
| 54 |
+
validation_prompt: null
|
| 55 |
+
validation_steps: 50
|
| 56 |
+
variant: null
|
| 57 |
+
with_prior_preservation: false
|
logs/custom-diffusion/events.out.tfevents.1776760580.cudahpc06.1354777.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dcec101914f2cef4c396054ab9d9d7312f2301d50199d63cccf61d6c1b231996
|
| 3 |
+
size 7058
|
logs/custom-diffusion/events.out.tfevents.1776761461.cudahpc06.1609186.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f38069a799fe9e7867858d1d6a3c37ff1ab22e49ff5adc5857d86f948c7139ea
|
| 3 |
+
size 20834
|
pytorch_custom_diffusion_weights.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:14c31fb696d54d323aef12a1f4d81554d692aea0e83a1199a948c41b533c54d5
|
| 3 |
+
size 76691351
|
sks.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c830276f62f773550b85fc452b14cb2f2b73acd659e02252ff98340cef91d3d5
|
| 3 |
+
size 151785119
|