Instructions to use BiomedSyn/ours with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use BiomedSyn/ours with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("BiomedSyn/ours", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
File size: 1,500 Bytes
75b1a45 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 | nohup accelerate launch train_lora.py \
--pretrained_model_name_or_path="CompVis/stable-diffusion-v1-4" \
--resolution=512 \
--learning_rate=1e-5 \
--train_batch_size=32 \
--gradient_accumulation_steps=1 \
--report_to=wandb \
--train_data_dir="/home/shuhan/blobdata_sd/AURA/dataset/" \
--train_data_prompt="/home/shuhan/blobdata_sd/AURA/dataset/json-layout2image/train_prompt_layout2image_multi.json" \
--validation_steps=10 \
--max_train_steps=10000 \
--validation_prompt "Normal." \
"mild Effusion on left lower lung." \
"mild Atelectasis on right lower lung, mild Effusion on left lower lung, mild Fibrosis on left lower lung, mild Fracture on right lung, mild Pleural Thickening on right lower lung." \
"severe Atelectasis on right lung, severe Consolidation on biliteral lung, mild Effusion on biliteral lung, severe Fibrosis on left lung."
nohup accelerate launch train_lora.py \
--pretrained_model_name_or_path="CompVis/stable-diffusion-v1-4" \
--resolution=512 \
--learning_rate=1e-5 \
--train_batch_size=32 \
--gradient_accumulation_steps=1 \
--report_to=wandb \
--train_data_dir="/home/shuhan/blobdata_sd/MIMIC" \
--train_data_prompt="/home/shuhan/blobdata_sd/MIMIC/MIMIC_train_PA_impression.json" \
--validation_steps=10 \
--max_train_steps=10000 \
--validation_prompt "Enlarged pleural effusion" \
"Enlarged cardiac silhouette" \
"Right upper lobe airspace opacities"
|