pixel_spritesheet_4walk_small_lora_v1

Prompt

A pixel art spritesheet of a medieval knight wearing metal armor and a helmet with a red plume. The spritesheet is a 4 by 4 grid of four rows of frames - first row is 3 walking frames facing down and 1 frame both arms raised, second row is 3 walking frames facing left and 1 frame jumping left, third row is 3 walking frames facing right and 1 frame jumping right, fourth row is 3 walking frames back view facing up and 1 frame lying on floor.

Prompt

A pixel art spritesheet of a witch with long red hair and blue eyes, wearing a purple hat and robes trimmed with white and light purple colors. The spritesheet is a 4 by 4 grid of four rows of frames - first row is 3 walking frames facing down and 1 frame both arms raised, second row is 3 walking frames facing left and 1 frame jumping left, third row is 3 walking frames facing right and 1 frame jumping right, fourth row is 3 walking frames back view facing up and 1 frame lying on floor.

Prompt

A pixel art spritesheet of a werewolf with light gray fur and yellow eyes, wearing a red scarf around his neck, and brown leather pants. The spritesheet is a 4 by 4 grid of four rows of frames - first row is 3 walking frames facing down and 1 frame both arms raised, second row is 3 walking frames facing left and 1 frame jumping left, third row is 3 walking frames facing right and 1 frame jumping right, fourth row is 3 walking frames back view facing up and 1 frame lying on floor.

Model description

A pixel art spritesheet LoRA for small 32x32 characters, with animation frames for walking up/down/left/right, standing with both arms raised, jumping left/right, and lying on the floor.

How to use

You can use the default FLUX.2 Klein base 4B workflows from ComfyUI. Both the text-to-image workflow and the edit base workflow work.

Images should be 512x512 because that's the size of the spritesheets used in training.

Both the 2750-steps LoRA and the 3000-steps LoRA are available. The 3000-steps version seems to be more consistent in making humanoid characters, but the 2750-steps version seems a bit more creative in non-humanoid characters if using edit + an image reference.

Does this LoRA work with FLUX.2 Klein 4B distilled?

No. It's technically compatible, but the distilled model ruins the quality of the pixels and the consistency. Use the base model.

How to get pixel-perfect images

To get pixel-perfect images, downscale by a factor of 4. So 512x512 images should downscale to 128x128. Using k-centroid scaling works well.

See the examples below:

Raw output	K-centroid downscaled, then upscaled back to 512x512

Using an image reference

You can use the edit workflow with an image reference of a character for your spritesheet.

Prompt: Create a pixel art spritesheet of the character in the image. The spritesheet is a 4 by 4 grid of four rows of frames - first row is 3 walking frames facing down and 1 frame both arms raised, second row is 3 walking frames facing left and 1 frame jumping left, third row is 3 walking frames facing right and 1 frame jumping right, fourth row is 3 walking frames back view facing up and 1 frame lying on floor.

Testing the spritesheets in a game

If you want to quickly test your spritesheets in a 2D game, here's a simple "sandbox" game/tool where you can upload the raw spritesheet outputs and spawn in your characters to move around:

Link to tool here

Source code here

Notes

This is a first attempt at making a pixel art spritesheet LoRA using small sprites. There are sometimes bad images generated with issues like hair or headwear being cut off, and non-human characters with bad anatomy. The bottom row of sprites with the back view also has problems with consistency sometimes (for example, the werewolf is missing the red scarf).

Credits

• The dataset used to train this LoRA consists of spritesheets edited and based on a template spritesheet by George Bailey, licensed under CC BY 4.0

Download model

Download them in the Files & versions tab.