README.md

---
license: cc-by-nc-4.0
tags:
- diffusion
- ddpm
- pixel-art
- pokemon
- text-to-image
library_name: pytorch
pipeline_tag: unconditional-image-generation
---

# Pokémon Pixel-Art Diffusion — checkpoints

Trained checkpoints for a **from-scratch DDPM** that generates 96×96 Pokémon pixel art
(by name, by free-text description, or by fusing two Pokémon).

**Code, model definitions & demo notebook:** https://github.com/weiee666/Pokemon_Combination

## Checkpoints

| file (`experiments/.../ckpt_ep300.pt`) | conditioning | attention | classes | params |
|---|---|---|---:|---:|
| `exp01_pokemon1070front_condUNet-CFG` | name embedding | – | 1070 | 4.2M |
| `exp02_pokemon20aug_condUNet-CFG-TB` | name embedding | – | 20 | 3.9M |
| `exp03_pokemon20aug_condUNet-CFG-attn-TB` | name embedding | self-attn | 20 | 5.8M |
| `exp04_pokemon20clean_bigUNet-CFG-attn-EMA` | name embedding | self-attn + EMA | 20 | 30.3M |
| `exp05_pokemon20aug_bigUNet-CFG-attn-EMA` | name embedding | self-attn + EMA | 20 | 30.3M |
| `exp06_stage1_pokemonALL_clipText` | CLIP pooled text | – | 988 | 30.5M |
| `exp07_stage1_pokemonALL_xattn` | CLIP per-token | self + cross-attn @24²/12² | 988 | 33.5M |
| `exp08_stage1_pokemonALL_xattn48` | CLIP per-token | self + cross-attn @48²/24²/12² | 988 | 34.0M |
| `exp09_stage1_pokemonALLcentered_xattn48` | CLIP per-token | self + cross-attn @48²/24²/12² | 988 | 34.0M |

`exp06_.../clip_table.pt` = pre-computed CLIP pooled vectors per class (needed by the exp06 model).

The checkpoints store **EMA weights** (for the experiments that use EMA). CLIP-conditioned
models (exp06–09) expect the CLIP ViT-B-32 (`laion2b_s34b_b79k`) text encoder.

## Load

```python
from huggingface_hub import hf_hub_download
import torch

ckpt = hf_hub_download(
    "WEIEE/pokemon-diffusion",
    "experiments/exp09_stage1_pokemonALLcentered_xattn48/checkpoints/ckpt_ep300.pt",
)
state = torch.load(ckpt, map_location="cpu")
# the matching UNet / Diffusion class definitions live in the GitHub notebooks
```

Educational / research project. Pokémon and all sprites are © Nintendo / Game Freak.