Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,62 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
tags:
|
| 5 |
+
- art
|
| 6 |
+
widget:
|
| 7 |
+
- text: Portrait of a jazz musician playing a saxophone under a streetlight
|
| 8 |
+
output:
|
| 9 |
+
url: images/000.png
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# MangaDF
|
| 13 |
+
|
| 14 |
+
## Model Description
|
| 15 |
+
|
| 16 |
+
**Model Type:** Stable Diffusion XL
|
| 17 |
+
**Base Model:** [stabilityai/stable-diffusion-xl-base-1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0)
|
| 18 |
+
**Finetuned On:** Images created by [alvdansen/BandW-Manga](https://huggingface.co/alvdansen/BandW-Manga)
|
| 19 |
+
|
| 20 |
+
## Overview
|
| 21 |
+
|
| 22 |
+
MangaDF is a finetuned version of the ['stabilityai/stable-diffusion-xl-base-1.0'](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) model. It has been specifically trained to generate bold line portrait illustrations, inspired by manga-style art. The finetuning dataset was created using images generated by the ['alvdansen/BandW-Manga'](https://huggingface.co/alvdansen/BandW-Manga) stable diffusion model, ensuring high-quality and stylistically consistent outputs.
|
| 23 |
+
|
| 24 |
+
|
| 25 |
+
## Intended Use
|
| 26 |
+
|
| 27 |
+
This model is designed for artists, illustrators, and enthusiasts who want to create manga-style bold line portraits. It can be used for various purposes, including concept art, character design, and graphic novels.
|
| 28 |
+
|
| 29 |
+
## How to Use
|
| 30 |
+
|
| 31 |
+
To use this model, you need to load it with the diffusers library in Python. Here's a quick start guide:
|
| 32 |
+
|
| 33 |
+
```python
|
| 34 |
+
from diffusers import DiffusionPipeline
|
| 35 |
+
import torch
|
| 36 |
+
|
| 37 |
+
# Load the base model and apply the LoRA weights
|
| 38 |
+
pipeline = DiffusionPipeline.from_pretrained(
|
| 39 |
+
"stabilityai/stable-diffusion-xl-base-1.0",
|
| 40 |
+
torch_dtype=torch.float16
|
| 41 |
+
).to("cuda")
|
| 42 |
+
pipeline.load_lora_weights("MangaDF.safetensors")
|
| 43 |
+
|
| 44 |
+
# Generate an image
|
| 45 |
+
prompt = "A bold line portrait of a fantasy character"
|
| 46 |
+
image = pipeline(prompt).images[0]
|
| 47 |
+
image
|
| 48 |
+
```
|
| 49 |
+
|
| 50 |
+
## Training Data
|
| 51 |
+
|
| 52 |
+
The finetuning dataset was created using images generated by the `alvdansen/BandW-Manga` stable diffusion model, which specializes in generating black and white manga-style illustrations. This dataset ensures that the MangaDF model produces high-quality and consistent manga-style bold line portraits.
|
| 53 |
+
|
| 54 |
+
## Acknowledgements
|
| 55 |
+
|
| 56 |
+
- Base model: [stabilityai/stable-diffusion-xl-base-1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0)
|
| 57 |
+
- Finetuning dataset: Created using images generated by [alvdansen/BandW-Manga](https://huggingface.co/alvdansen/BandW-Manga)
|
| 58 |
+
|
| 59 |
+
This model card now accurately reflects the source of the finetuning dataset.
|
| 60 |
+
## Contact
|
| 61 |
+
|
| 62 |
+
For any questions or issues, please contact [me](https://www.linkedin.com/in/chanyalcin/)
|