Chan-Y commited on
Commit
6b5481e
·
verified ·
1 Parent(s): 6532438

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +62 -3
README.md CHANGED
@@ -1,3 +1,62 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: diffusers
4
+ tags:
5
+ - art
6
+ widget:
7
+ - text: Portrait of a jazz musician playing a saxophone under a streetlight
8
+ output:
9
+ url: images/000.png
10
+ ---
11
+
12
+ # MangaDF
13
+
14
+ ## Model Description
15
+
16
+ **Model Type:** Stable Diffusion XL
17
+ **Base Model:** [stabilityai/stable-diffusion-xl-base-1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0)
18
+ **Finetuned On:** Images created by [alvdansen/BandW-Manga](https://huggingface.co/alvdansen/BandW-Manga)
19
+
20
+ ## Overview
21
+
22
+ MangaDF is a finetuned version of the ['stabilityai/stable-diffusion-xl-base-1.0'](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0) model. It has been specifically trained to generate bold line portrait illustrations, inspired by manga-style art. The finetuning dataset was created using images generated by the ['alvdansen/BandW-Manga'](https://huggingface.co/alvdansen/BandW-Manga) stable diffusion model, ensuring high-quality and stylistically consistent outputs.
23
+
24
+
25
+ ## Intended Use
26
+
27
+ This model is designed for artists, illustrators, and enthusiasts who want to create manga-style bold line portraits. It can be used for various purposes, including concept art, character design, and graphic novels.
28
+
29
+ ## How to Use
30
+
31
+ To use this model, you need to load it with the diffusers library in Python. Here's a quick start guide:
32
+
33
+ ```python
34
+ from diffusers import DiffusionPipeline
35
+ import torch
36
+
37
+ # Load the base model and apply the LoRA weights
38
+ pipeline = DiffusionPipeline.from_pretrained(
39
+ "stabilityai/stable-diffusion-xl-base-1.0",
40
+ torch_dtype=torch.float16
41
+ ).to("cuda")
42
+ pipeline.load_lora_weights("MangaDF.safetensors")
43
+
44
+ # Generate an image
45
+ prompt = "A bold line portrait of a fantasy character"
46
+ image = pipeline(prompt).images[0]
47
+ image
48
+ ```
49
+
50
+ ## Training Data
51
+
52
+ The finetuning dataset was created using images generated by the `alvdansen/BandW-Manga` stable diffusion model, which specializes in generating black and white manga-style illustrations. This dataset ensures that the MangaDF model produces high-quality and consistent manga-style bold line portraits.
53
+
54
+ ## Acknowledgements
55
+
56
+ - Base model: [stabilityai/stable-diffusion-xl-base-1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0)
57
+ - Finetuning dataset: Created using images generated by [alvdansen/BandW-Manga](https://huggingface.co/alvdansen/BandW-Manga)
58
+
59
+ This model card now accurately reflects the source of the finetuning dataset.
60
+ ## Contact
61
+
62
+ For any questions or issues, please contact [me](https://www.linkedin.com/in/chanyalcin/)