File size: 18,292 Bytes
cf2950f 345d176 b760595 44374d0 b760595 44374d0 b760595 345d176 b760595 345d176 b760595 345d176 b760595 345d176 b760595 345d176 b760595 345d176 b760595 345d176 b760595 345d176 b760595 345d176 b760595 345d176 44374d0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 | ---
datasets:
- rullaf/mtg-art
pipeline_tag: text-to-image
tags:
- art
---
# Magic Diffusion
A text2img model derived from StableDiffusion 1.5, fine-tuned with [EveryDream-trainer](https://github.com/victorchall/EveryDream-trainer) on a dataset consisting of post-processed Magic the Gathering card art crops (32,159), and hi-resolution images of the art (13,048). Annotations are based on card metadata and various other sources, including art description.
## Comparison
For MtG card art, this model performs comparably to Fantasy Card Diffusion v1. Both outperform generic models such as Open Journey v2, and baseline Stable Diffusion 1.5.
Conclusions:
* Magic Diffusion v2 likes to draw borders and frames
* Fantasy Card Diffusion v1 better preserves the MtG art style than Magic Diffusion v2, but it suffers from halftone/rosetta artifacts
* OpenJourney v2 is much hornier than the rest of the models, but the results for generic concepts are comparable
* Stable Diffusion v1.5 produces noticeably worse results than the other models, and requires a lot of negative keywords
* All models seem to benefit from feature description, such as “sliver creature with long beak and tendrils” instead of just “sliver”
### Settings
* Magic Diffusion v2 – this model
* Fantasy Card Diffusion v1 – https://huggingface.co/volrath50/fantasy-card-diffusion
* Open Journey v2 – https://huggingface.co/prompthero/openjourney-v2
* Stable Diffusion 1.5 – https://huggingface.co/runwayml/stable-diffusion-v1-5
All images were generated with identical settings:
* 40 steps
* 512x512
* seed `1111`, `2345`, `3579`, `4813`, `6047`, `7281`, `8515`, `9749`
Presumably the results could be further improved with better prompts, targeted at specific models, but that is not the point of this comparison. Magic Diffusion does better without “artist signature”, Fantasy Card Diffusion may benefit from “halftone rosetta”, and Stable Diffusion 1.5 likes to draw the card frames.
### Sliver
Prompt
> speedy sliver creature Creature a fast sliver is speeding through the Mardu steppe landscape Khans of tarkir beautiful composition, MTG card art by John avon
Negative Prompt
> text frame card border human humanoid artist signature
<table>
<tr>
<th><strong>Magic Diffusion v2</strong></th>
<th>Fantasy Card Diffusion v1</th>
<th>Openjourney v2</th>
<th>Stable Diffusion 1.5</th>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/1111.png" alt="mdv2 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/1111.png" alt="fcd v1 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/1111.png" alt="oj v2 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/1111.png" alt="sd 1.5 1111"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/2345.png" alt="mdv2 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/2345.png" alt="fcd v1 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/2345.png" alt="oj v2 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/2345.png" alt="sd 1.5 2345"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/3579.png" alt="mdv2 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/3579.png" alt="fcd v1 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/3579.png" alt="oj v2 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/3579.png" alt="sd 1.5 3579"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/4813.png" alt="mdv2 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/4813.png" alt="fcd v1 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/4813.png" alt="oj v2 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/4813.png" alt="sd 1.5 4813"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/6047.png" alt="mdv2 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/6047.png" alt="fcd v1 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/6047.png" alt="oj v2 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/6047.png" alt="sd 1.5 6047"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/7281.png" alt="mdv2 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/7281.png" alt="fcd v1 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/7281.png" alt="oj v2 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/7281.png" alt="sd 1.5 7281"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/8515.png" alt="mdv2 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/8515.png" alt="fcd v1 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/8515.png" alt="oj v2 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/8515.png" alt="sd 1.5 8515"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/magicdiffusion-v2/9749.png" alt="mdv2 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/fantasycarddiffusion-v1/9749.png" alt="fcd v1 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/openjourney-v2/9749.png" alt="oj v2 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/sliver/stablediffusion-v1.5/9749.png" alt="sd 1.5 9749"></td>
</tr>
</table>
### Taylor
Prompt
> mtg card art Taylor Swift wandering bard legendary creature human bard by chris rahn by volkan baga by zoltan boros armored bard taylor swift holding her weapons and instruments beautiful composition detailed realistic fantasy painting masterpiece best quality
Negative Prompt
> guitar lowres bad anatomy bad hands text error missing fingers extra digit fewer digits cropped worst quality low quality normal quality jpeg artifacts signature watermark username blurry
<table>
<tr>
<th><strong>Magic Diffusion v2</strong></th>
<th>Fantasy Card Diffusion v1</th>
<th>Openjourney v2</th>
<th>Stable Diffusion 1.5</th>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/1111.png" alt="mdv2 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/1111.png" alt="fcd v1 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/1111.png" alt="oj v2 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/1111.png" alt="sd 1.5 1111"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/2345.png" alt="mdv2 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/2345.png" alt="fcd v1 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/2345.png" alt="oj v2 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/2345.png" alt="sd 1.5 2345"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/3579.png" alt="mdv2 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/3579.png" alt="fcd v1 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/3579.png" alt="oj v2 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/3579.png" alt="sd 1.5 3579"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/4813.png" alt="mdv2 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/4813.png" alt="fcd v1 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/4813.png" alt="oj v2 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/4813.png" alt="sd 1.5 4813"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/6047.png" alt="mdv2 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/6047.png" alt="fcd v1 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/6047.png" alt="oj v2 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/6047.png" alt="sd 1.5 6047"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/7281.png" alt="mdv2 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/7281.png" alt="fcd v1 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/7281.png" alt="oj v2 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/7281.png" alt="sd 1.5 7281"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/8515.png" alt="mdv2 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/8515.png" alt="fcd v1 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/8515.png" alt="oj v2 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/8515.png" alt="sd 1.5 8515"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/magicdiffusion-v2/9749.png" alt="mdv2 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/fantasycarddiffusion-v1/9749.png" alt="fcd v1 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/openjourney-v2/9749.png" alt="oj v2 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/taylor/stablediffusion-v1.5/9749.png" alt="sd 1.5 9749"></td>
</tr>
</table>
### Mox
Prompt
> mox topaz artifact on a chain rare mtg card art by dan frazier
Negative Prompt
> card border frame lowres cropped worst quality low quality normal quality jpeg artifacts watermark blurry
<table>
<tr>
<th><strong>Magic Diffusion v2</strong></th>
<th>Fantasy Card Diffusion v1</th>
<th>Openjourney v2</th>
<th>Stable Diffusion 1.5</th>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/magicdiffusion-v2/1111.png" alt="mdv2 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/fantasycarddiffusion-v1/1111.png" alt="fcd v1 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/openjourney-v2/1111.png" alt="oj v2 1111"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/stablediffusion-v1.5/1111.png" alt="sd 1.5 1111"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/magicdiffusion-v2/2345.png" alt="mdv2 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/fantasycarddiffusion-v1/2345.png" alt="fcd v1 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/openjourney-v2/2345.png" alt="oj v2 2345"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/stablediffusion-v1.5/2345.png" alt="sd 1.5 2345"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/magicdiffusion-v2/3579.png" alt="mdv2 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/fantasycarddiffusion-v1/3579.png" alt="fcd v1 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/openjourney-v2/3579.png" alt="oj v2 3579"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/stablediffusion-v1.5/3579.png" alt="sd 1.5 3579"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/magicdiffusion-v2/4813.png" alt="mdv2 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/fantasycarddiffusion-v1/4813.png" alt="fcd v1 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/openjourney-v2/4813.png" alt="oj v2 4813"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/stablediffusion-v1.5/4813.png" alt="sd 1.5 4813"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/magicdiffusion-v2/6047.png" alt="mdv2 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/fantasycarddiffusion-v1/6047.png" alt="fcd v1 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/openjourney-v2/6047.png" alt="oj v2 6047"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/stablediffusion-v1.5/6047.png" alt="sd 1.5 6047"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/magicdiffusion-v2/7281.png" alt="mdv2 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/fantasycarddiffusion-v1/7281.png" alt="fcd v1 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/openjourney-v2/7281.png" alt="oj v2 7281"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/stablediffusion-v1.5/7281.png" alt="sd 1.5 7281"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/magicdiffusion-v2/8515.png" alt="mdv2 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/fantasycarddiffusion-v1/8515.png" alt="fcd v1 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/openjourney-v2/8515.png" alt="oj v2 8515"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/stablediffusion-v1.5/8515.png" alt="sd 1.5 8515"></td>
</tr>
<tr>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/magicdiffusion-v2/9749.png" alt="mdv2 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/fantasycarddiffusion-v1/9749.png" alt="fcd v1 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/openjourney-v2/9749.png" alt="oj v2 9749"></td>
<td><img src="https://huggingface.co/rullaf/magic-diffusion/resolve/main/examples/mox/stablediffusion-v1.5/9749.png" alt="sd 1.5 9749"></td>
</tr>
</table>
|