File size: 7,125 Bytes
4d2f977 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 | ---
tags:
- text-to-image
- lora
- diffusers
- template:diffusion-lora
widget:
- output:
url: images/knight.png
text: >-
A pixel art sprite of a medieval knight wearing metal armor and a helmet
with a red plume, a sword in one hand and a shield in the other hand. The
background is white.
- output:
url: images/witch.png
text: >-
A pixel art image of a witch with long red hair and blue eyes, wearing a
purple hat and robes trimmed with white and light purple colors. White
background
- output:
url: images/butler.png
text: >-
A pixel art image of a man with light brown hair in a long ponytail. He is
wearing a butler outfit and leaning forward towards the viewer holding a
bowl of soup. The background is a fancy restaurant with dining tables in the
back, a chandelier, and a painting of a noblewoman on the left walls.
- output:
url: images/island_base.png
text: >-
A pixel art aerial shot of an island in the middle of the ocean. On the
right side of the island is a giant metal orb building with a satellite on
top of it.
- output:
url: images/sand_dunes_tower.png
text: >-
A pixel art scene of wide, vast sand dunes with a tall cylindrical tower in
the far background surrounded by a sandstorm. In the foreground is a
medieval carriage being pulled by a triceratops moving towards the tower.
- output:
url: images/stairs_darkness_eyes.png
text: >-
A pixel art image of a top-down view of stairs leading down into darkness.
In the background the darkness has several faint red eyes.
- output:
url: images/ddagger_grid.png
text: >-
A pixel art sprite of a short red dagger with a green poisoned tip on the
top right and a gray and brown hilt. There are 16 copies of the sprite in a
4 by 4 grid. The background is white.
- output:
url: images/dshield.png
text: >-
A pixel art sprite of a rectangular orange shield with the head of a gray
dragon with its mouth open facing straight. The background is white.
- output:
url: images/skeleton_sprite.png
text: >-
A pixel art sprite of a skeleton warrior wearing a helmet with two horns,
holding an axe with both hands raised, facing right, white background
base_model: baidu/ERNIE-Image
instance_prompt: null
license: apache-2.0
---
# pixel_assets_general_ernie_v1
<Gallery />
## Model description
A pixel art LoRA for general-purpose game assets such as character sprites, creatures, items/equipment, backgrounds, scenery, and icons.
## How to use
You can use the default ERNIE-Image-Turbo workflow from ComfyUI, and no prompt enhancer needed. The sample images also have workflows.
## How to get pixel-perfect images
Downscale by a factor of 4. So 512x512 images should downscale to 128x128, 1024x1024 to 256x256, and so on. Using k-centroid with something like [PixelOE](https://github.com/KohakuBlueleaf/PixelOE) works well.
See examples below:
| Raw output | K-centroid downscaled, then upscaled back 4x|
| ------------- | ------------- |
|  |  |
|  |  |
|  |  |
|  |  |
|  |  |
|  | 
|  |  |
|  |  |
|  |  |
## Does this LoRA work with ERNIE-Image base?
Yes, but I don't recommend it. **The LoRA is meant to be used with the turbo model.** For some reason, outputs with the base model are very bad. The colors are way too bright or saturated, and there are more issues with anatomy. Maybe there's a problem with my settings.
## Notes & Issues
There are still some issues with certain prompts with the ERNIE turbo model.
- The model tends to make characters face forward or in a 3/4 angle even if your prompt has a different view. This might just be a limit of the turbo model, though.
- If prompting for sprites, make sure to include "white background" somewhere, otherwise you'll sometimes get a detailed background.
- Since I trained this on a 4x upscaled pixel art dataset, if you want smaller sprites, just prompt for copies of a sprite in a 2x2 or 4x4 grid (see the sample images).
- The dataset this LoRA was trained on contains 512x512, 768x768, and 1024x1024 images, but you can change the resolution and still get decent images.
## Download model
[Download](/svntax-dev/pixel_assets_general_ernie_v1/tree/main) them in the Files & versions tab.
|