Instructions to use jdopensource/JoyAI-Image-Edit-Plus-Diffusers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use jdopensource/JoyAI-Image-Edit-Plus-Diffusers with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("jdopensource/JoyAI-Image-Edit-Plus-Diffusers", dtype=torch.bfloat16, device_map="cuda") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -24,11 +24,6 @@ JoyAI-Image Edit Plus is a multi-image instruction-guided editing model from the
|
|
| 24 |
| VAE | AutoencoderKLWan | 240M |
|
| 25 |
| Scheduler | FlowMatchEulerDiscreteScheduler | - |
|
| 26 |
|
| 27 |
-
Key design:
|
| 28 |
-
- **Patchified latent representation**: Input images and target noise are independently patchified into `[B, max_patches, C, pt, ph, pw]` format with a `target_mask` to distinguish target noise from reference patches.
|
| 29 |
-
- **Variable reference images**: Supports 1–6 reference images per sample via dynamic `shape_list`.
|
| 30 |
-
- **Norm-guided CFG**: Batch-concatenated classifier-free guidance with norm rescaling in a single forward pass.
|
| 31 |
-
|
| 32 |
## Installation
|
| 33 |
|
| 34 |
`JoyImageEditPlusPipeline` has not yet been merged into the official diffusers release. Before it is available in a stable version, you need to install diffusers from the PR branch:
|
|
@@ -127,7 +122,7 @@ python inference.py \
|
|
| 127 |
```bibtex
|
| 128 |
@misc{joyai-image-2025,
|
| 129 |
title={JoyAI-Image: A Unified Multimodal Foundation Model for Image Understanding, Generation, and Editing},
|
| 130 |
-
author={
|
| 131 |
year={2025},
|
| 132 |
url={https://github.com/jd-opensource/JoyAI-Image}
|
| 133 |
}
|
|
|
|
| 24 |
| VAE | AutoencoderKLWan | 240M |
|
| 25 |
| Scheduler | FlowMatchEulerDiscreteScheduler | - |
|
| 26 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
## Installation
|
| 28 |
|
| 29 |
`JoyImageEditPlusPipeline` has not yet been merged into the official diffusers release. Before it is available in a stable version, you need to install diffusers from the PR branch:
|
|
|
|
| 122 |
```bibtex
|
| 123 |
@misc{joyai-image-2025,
|
| 124 |
title={JoyAI-Image: A Unified Multimodal Foundation Model for Image Understanding, Generation, and Editing},
|
| 125 |
+
author={Joy Future Academy, JD},
|
| 126 |
year={2025},
|
| 127 |
url={https://github.com/jd-opensource/JoyAI-Image}
|
| 128 |
}
|