Text-to-Image
Diffusers
TensorBoard
Safetensors
stable-diffusion
stable-diffusion-diffusers
custom-diffusion
Instructions to use SidXXD/412 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SidXXD/412 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SidXXD/412", dtype=torch.bfloat16, device_map="cuda") prompt = "photo of a sks person" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Draw Things
- DiffusionBee
End of training
Browse files- README.md +22 -0
- checkpoint-250/custom_checkpoint_0.pkl +3 -0
- checkpoint-250/model.safetensors +3 -0
- checkpoint-250/model_1.safetensors +3 -0
- checkpoint-250/optimizer.bin +3 -0
- checkpoint-250/random_states_0.pkl +3 -0
- checkpoint-250/scheduler.bin +3 -0
- concepts_list.json +1 -0
- logs/custom-diffusion/1776761987.2171655/events.out.tfevents.1776761987.cudahpc06.1783823.1 +3 -0
- logs/custom-diffusion/1776761987.2207522/hparams.yml +57 -0
- logs/custom-diffusion/events.out.tfevents.1776761987.cudahpc06.1783823.0 +3 -0
- pytorch_custom_diffusion_weights.bin +3 -0
- sks.bin +3 -0
README.md
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
---
|
| 3 |
+
license: creativeml-openrail-m
|
| 4 |
+
base_model: runwayml/stable-diffusion-v1-5
|
| 5 |
+
instance_prompt: photo of a sks person
|
| 6 |
+
tags:
|
| 7 |
+
- stable-diffusion
|
| 8 |
+
- stable-diffusion-diffusers
|
| 9 |
+
- text-to-image
|
| 10 |
+
- diffusers
|
| 11 |
+
- custom-diffusion
|
| 12 |
+
inference: true
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# Custom Diffusion - SidXXD/412
|
| 16 |
+
|
| 17 |
+
These are Custom Diffusion adaption weights for runwayml/stable-diffusion-v1-5. The weights were trained on photo of a sks person using [Custom Diffusion](https://www.cs.cmu.edu/~custom-diffusion). You can find some example images in the following.
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
|
| 21 |
+
|
| 22 |
+
For more details on the training, please follow [this link](https://github.com/huggingface/diffusers/blob/main/examples/custom_diffusion).
|
checkpoint-250/custom_checkpoint_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d9e2900d73897e6b0aa5729a3bdf86d1f574c971f0a0cea6c7d552221c70ca97
|
| 3 |
+
size 76689565
|
checkpoint-250/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a77de9e3324cc487e0f62aeb8c40cd67ee2164c2977c268ee7e755cf504337e1
|
| 3 |
+
size 76682360
|
checkpoint-250/model_1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:027a6d4e3aef02125b172c4ed75df0d82377de192bd0f2df738afa7b5e51eb7f
|
| 3 |
+
size 492268240
|
checkpoint-250/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:821831b8ed0b67201511b0111656081f4c8679cd41b0dd557edb40907bcd111c
|
| 3 |
+
size 456950854
|
checkpoint-250/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c6eb5ec820400e1f43f1dd79aeea0f24e2ca290b76bf91d8dac2834d6a29c839
|
| 3 |
+
size 14727
|
checkpoint-250/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c54c7dfa0981e4f3405702dde32f7c139b056257f5c201760ea6fbfb47a4b1d7
|
| 3 |
+
size 563
|
concepts_list.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
[{"instance_prompt": "photo of a sks person", "class_prompt": null, "instance_data_dir": "/data/144-1/users/xide/Code/HAAD/outputs/1-for_demo/4-faces/250/412", "class_data_dir": null}]
|
logs/custom-diffusion/1776761987.2171655/events.out.tfevents.1776761987.cudahpc06.1783823.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8837601813d8970de204ee0d12abd29d8c61bf8a679c80642d0c2bac5b54eac4
|
| 3 |
+
size 2715
|
logs/custom-diffusion/1776761987.2207522/hparams.yml
ADDED
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
adam_beta1: 0.9
|
| 2 |
+
adam_beta2: 0.999
|
| 3 |
+
adam_epsilon: 1.0e-08
|
| 4 |
+
adam_weight_decay: 0.01
|
| 5 |
+
allow_tf32: false
|
| 6 |
+
center_crop: false
|
| 7 |
+
checkpointing_steps: 250
|
| 8 |
+
checkpoints_total_limit: null
|
| 9 |
+
class_data_dir: null
|
| 10 |
+
class_prompt: null
|
| 11 |
+
concepts_list: null
|
| 12 |
+
dataloader_num_workers: 2
|
| 13 |
+
enable_xformers_memory_efficient_attention: false
|
| 14 |
+
freeze_model: crossattn_kv
|
| 15 |
+
gradient_accumulation_steps: 1
|
| 16 |
+
gradient_checkpointing: false
|
| 17 |
+
hflip: true
|
| 18 |
+
hub_model_id: null
|
| 19 |
+
hub_token: null
|
| 20 |
+
initializer_token: ktn
|
| 21 |
+
instance_data_dir: /data/144-1/users/xide/Code/HAAD/outputs/1-for_demo/4-faces/250/412
|
| 22 |
+
instance_prompt: photo of a sks person
|
| 23 |
+
learning_rate: 1.0e-05
|
| 24 |
+
local_rank: -1
|
| 25 |
+
logging_dir: logs
|
| 26 |
+
lr_scheduler: constant
|
| 27 |
+
lr_warmup_steps: 0
|
| 28 |
+
max_grad_norm: 1.0
|
| 29 |
+
max_train_steps: 250
|
| 30 |
+
mixed_precision: null
|
| 31 |
+
modifier_token: sks
|
| 32 |
+
no_safe_serialization: true
|
| 33 |
+
noaug: false
|
| 34 |
+
num_class_images: 200
|
| 35 |
+
num_train_epochs: 1
|
| 36 |
+
num_validation_images: 2
|
| 37 |
+
output_dir: /data/144-1/users/xide/Code/custom_diffusion/results/model/412
|
| 38 |
+
pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
|
| 39 |
+
prior_generation_precision: null
|
| 40 |
+
prior_loss_weight: 0
|
| 41 |
+
push_to_hub: true
|
| 42 |
+
real_prior: false
|
| 43 |
+
report_to: tensorboard
|
| 44 |
+
resolution: 512
|
| 45 |
+
resume_from_checkpoint: null
|
| 46 |
+
revision: null
|
| 47 |
+
sample_batch_size: 4
|
| 48 |
+
scale_lr: true
|
| 49 |
+
seed: 42
|
| 50 |
+
set_grads_to_none: false
|
| 51 |
+
tokenizer_name: null
|
| 52 |
+
train_batch_size: 2
|
| 53 |
+
use_8bit_adam: false
|
| 54 |
+
validation_prompt: null
|
| 55 |
+
validation_steps: 50
|
| 56 |
+
variant: null
|
| 57 |
+
with_prior_preservation: false
|
logs/custom-diffusion/events.out.tfevents.1776761987.cudahpc06.1783823.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ece1417f060806ccc2e29a07b6f585cf8b7f39675caf6d18f03f44e84da854e1
|
| 3 |
+
size 20834
|
pytorch_custom_diffusion_weights.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:62155cd3cfb6868f42d762b941c3c3638233d409fe1a2c04c06611b1c77e322d
|
| 3 |
+
size 76691351
|
sks.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:12ba9e99b4d48f0518621d0b8ac162d3dc0c61ded4d83442f07e566bd211deb6
|
| 3 |
+
size 151785119
|