Buckets:
| license: other | |
| license_name: krea-2-community-license | |
| license_link: https://huggingface.co/krea/Krea-2-Raw/blob/main/LICENSE.pdf | |
| base_model: krea/krea-2-raw | |
| pipeline_tag: image-to-image | |
| tags: | |
| - image-editing | |
| - image-to-image | |
| - lora | |
| - controlnet | |
| - canny | |
| - krea | |
| - comfyui | |
| # Nynxz's Krea 2 Edit (NK2E) | |
| A set of in-context LoRAs for Krea 2. The edit LoRAs take a source image and a text | |
| instruction (like "give her pink hair" or "add sunglasses") and edit the image. A | |
| separate canny control LoRA takes an edge map and generates an image that follows it. | |
| > [!WARNING] | |
| > Experimental and unofficial. Results are rough and inconsistent, and vary a lot by | |
| > edit type. Not affiliated with or endorsed by Krea. | |
| ## Demo | |
| Try it in your browser — no install required — on the Hugging Face Space: | |
| [](https://huggingface.co/spaces/nynxz/nk2e-krea2-editor) | |
| **→ https://huggingface.co/spaces/nynxz/nk2e-krea2-editor** | |
| ## Links | |
| - Live demo (Space): https://huggingface.co/spaces/nynxz/nk2e-krea2-editor | |
| - ComfyUI Node Pack: https://github.com/Nynxz/ComfyUI-NK2E | |
| - Training Toolkit: https://github.com/Nynxz/NK2E | |
| ## Use (ComfyUI) | |
| 1. Download a LoRA from `comfy/v0.3/` (recommended) into your ComfyUI `models/loras/`. | |
| 2. Install the node pack (link above) and load its example workflow. | |
| Strength around 0.7 is a good start. The reference is the source image (or, for the | |
| canny LoRA, an edge map). | |
| ## Versions | |
| | Version | File | Rank | Steps | Training data | Notes | | |
| |---|---|---|---|---|---| | |
| | v0.3 | comfy/v0.3/NK2E-v0.3.safetensors | 64 | 24k | v0.1 mix + UltraEdit + HQ-Edit (~72k pairs) | recommended (newest) | | |
| | v0.2 | comfy/v0.2/NK2E-v0.2.safetensors | 64 | 12k | same ~72k mix | continued from v0.1 | | |
| | v0.1 | comfy/v0.1/NK2E-v0.1.safetensors | 64 | 8k | MagicBrush + OmniEdit + InstructPix2Pix (~37k) | first release | | |
| | canny v0.1 | comfy/canny_v0.1/NK2E-canny-v0.1.safetensors | 32 | 12k | 8k COCO canny pairs | control LoRA (see below) | | |
| See CHANGELOG.md for history. | |
| ## What it does well (and not) | |
| - Good at: keeping identity and composition, localized edits (hair, accessories, | |
| objects), and global style or lighting changes. | |
| - Weaker at: recolouring a whole large region, and scene or structure changes (swapping | |
| a background, adding a person, re-posing). | |
| It is not a mask or inpaint model; identity is preserved without a mask. | |
| ## Canny control (experimental) | |
| `comfy/canny_v0.1/` is a separate control LoRA (ControlNet-style, in-context). Feed a | |
| **canny edge map** as the reference instead of a source image: structure comes from the | |
| edges, content from the text prompt. Same node setup as editing. It follows the outline | |
| but is softer than a pixel-locked ControlNet. Depth and pose are planned, same recipe. | |
| ## Specialist LoRAs | |
| `comfy/loras/` holds narrow, single-purpose edit LoRAs trained on top of the generalist. | |
| Each responds to one **trigger instruction** rather than general edits, and loads with the | |
| same node setup. Because they are low-rank and concept-specific, they usually want a higher | |
| strength (start near 1.0). | |
| | Specialist | File | Base | Trigger | | |
| |---|---|---|---| | |
| | Invisible Man | comfy/loras/NK2E-InvisibleMan-v0.1.safetensors | v0.3 | `make person invisible` | | |
| See comfy/loras/README.md for details and triggers. | |
| ## Training a specialist on top | |
| `comfy/` holds ComfyUI-format weights for inference; `train/` holds native-format weights | |
| for training. Point the toolkit's `base_lora` at `train/v0.3/NK2E-v0.3-train.safetensors` | |
| (the latest generalist native) to train a narrow specialist on top — this is how the | |
| specialists in `comfy/loras/` were made. See the training toolkit (link above). | |
| ## License | |
| Krea 2 Community License (see LICENSE and NOTICE); commercial use only under $1M/yr revenue. | |
| Not an official Krea project. | |
Xet Storage Details
- Size:
- 3.92 kB
- Xet hash:
- 05fedf7cc367e129b51cb2932643e5881ae6c93662ccdace3bbecaebb917d26c
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.