Instructions to use Trelis/avatar-2epochs with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Trelis/avatar-2epochs with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Trelis/avatar-2epochs", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Delete Junk
#1
by qpqpqpqpqpqp - opened
.ipynb_checkpoints/config-checkpoint.yaml
DELETED
|
@@ -1,54 +0,0 @@
|
|
| 1 |
-
tracker_project_name: memo
|
| 2 |
-
output_dir: outputs/finetune
|
| 3 |
-
resume_from_checkpoint: null
|
| 4 |
-
model_name_or_path: memoavatar/memo
|
| 5 |
-
vae: stabilityai/sd-vae-ft-mse
|
| 6 |
-
gradient_checkpointing: true
|
| 7 |
-
gradient_accumulation_steps: 1
|
| 8 |
-
train_batch_size: 1
|
| 9 |
-
max_train_steps: 1500
|
| 10 |
-
enable_xformers_memory_efficient_attention: true
|
| 11 |
-
checkpoints_total_limit: 20
|
| 12 |
-
robust_training: true
|
| 13 |
-
learning_rate: 1.0e-05
|
| 14 |
-
max_grad_norm: 1.0
|
| 15 |
-
scale_lr: false
|
| 16 |
-
lr_scheduler: constant
|
| 17 |
-
lr_warmup_steps: 0
|
| 18 |
-
seed: 42
|
| 19 |
-
mixed_precision: bf16
|
| 20 |
-
use_8bit_adam: false
|
| 21 |
-
allow_tf32: true
|
| 22 |
-
use_ema: false
|
| 23 |
-
adam_beta1: 0.9
|
| 24 |
-
adam_beta2: 0.999
|
| 25 |
-
adam_weight_decay: 0.01
|
| 26 |
-
adam_epsilon: 1.0e-08
|
| 27 |
-
dataloader_num_workers: 16
|
| 28 |
-
prefetch_factor: 4
|
| 29 |
-
checkpointing_steps: 5000
|
| 30 |
-
data:
|
| 31 |
-
width: 512
|
| 32 |
-
height: 512
|
| 33 |
-
num_past_frames: 16
|
| 34 |
-
dynamic_past_frames: false
|
| 35 |
-
n_sample_frames: 16
|
| 36 |
-
audio_margin: 2
|
| 37 |
-
metadata_paths:
|
| 38 |
-
- data/embedding/metadata.jsonl
|
| 39 |
-
weighting_scheme: logit_normal
|
| 40 |
-
logit_mean: 0.0
|
| 41 |
-
logit_std: 1.0
|
| 42 |
-
mode_scale: 1.29
|
| 43 |
-
noise_scheduler_kwargs:
|
| 44 |
-
num_train_timesteps: 1000
|
| 45 |
-
train_reference_net: false
|
| 46 |
-
train_diffusion_net: true
|
| 47 |
-
train_image_proj: false
|
| 48 |
-
train_audio_proj: false
|
| 49 |
-
trainable_modules:
|
| 50 |
-
- motion_modules
|
| 51 |
-
- audio_modules
|
| 52 |
-
uncond_img_ratio: 0.05
|
| 53 |
-
uncond_audio_ratio: 0.05
|
| 54 |
-
start_ratio: 0.05
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|