Upload PiEa checkpoint
Browse files- .gitattributes +1 -0
- README.md +77 -0
- config.json +24 -0
- eval_comparison_grid.png +3 -0
- evaluation_report.json +15 -0
- model.safetensors +3 -0
- training_report.json +54 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
eval_comparison_grid.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,3 +1,80 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
pipeline_tag: image-to-image
|
| 6 |
+
library_name: pytorch
|
| 7 |
+
tags:
|
| 8 |
+
- image-to-image
|
| 9 |
+
- diffusion
|
| 10 |
+
- pixel-diffusion-decoder
|
| 11 |
+
- super-resolution
|
| 12 |
+
- denoising
|
| 13 |
+
- pytorch
|
| 14 |
+
- safetensors
|
| 15 |
+
- pie
|
| 16 |
---
|
| 17 |
+
|
| 18 |
+
# PiEa: Pixel Diffusion Decoder
|
| 19 |
+
|
| 20 |
+
`PiEa` is a compact image-to-image Pixel Diffusion Decoder. It is trained to reconstruct clean pixels from noisy pixels while conditioning on a degraded version of the same image. The model is designed for decoder-style image restoration, image refinement, and pixel-space reconstruction experiments.
|
| 21 |
+
|
| 22 |
+
PiEa is not a text-to-image generator. It is a decoder component: it expects image-like conditioning and produces image-like denoising predictions.
|
| 23 |
+
|
| 24 |
+
## Model details
|
| 25 |
+
|
| 26 |
+
| Property | Value |
|
| 27 |
+
| --- | --- |
|
| 28 |
+
| Model name | `PiEa` |
|
| 29 |
+
| Developer | PiEa-ai |
|
| 30 |
+
| Model type | Pixel diffusion decoder |
|
| 31 |
+
| Input type | `PiE` |
|
| 32 |
+
| Architecture | Compact U-Net diffusion decoder |
|
| 33 |
+
| Parameters | 1,010,776,675 |
|
| 34 |
+
| Resolution | 512 x 512 |
|
| 35 |
+
| Base channels | 464 |
|
| 36 |
+
| Channel multipliers | [1, 2, 4, 6] |
|
| 37 |
+
| Dataset used | `['huggan/wikiart', 'huggan/smithsonian_butterflies_subset']` |
|
| 38 |
+
| Optimizer | AdamW |
|
| 39 |
+
| Precision | bfloat16 autocast |
|
| 40 |
+
|
| 41 |
+
## Throughput
|
| 42 |
+
|
| 43 |
+
| Metric | Value |
|
| 44 |
+
| --- | --- |
|
| 45 |
+
| Training steps | 9,141 |
|
| 46 |
+
| Image tokens processed | 2,396,258,304 |
|
| 47 |
+
| Image tokens/sec | 1331229.59 |
|
| 48 |
+
| Target image tokens/sec | 250,000 |
|
| 49 |
+
| Final loss | 0.023287 |
|
| 50 |
+
|
| 51 |
+
Image tokens are counted as processed spatial pixels: `batch_size * height * width` per optimization step.
|
| 52 |
+
|
| 53 |
+
## Usage
|
| 54 |
+
|
| 55 |
+
This checkpoint is saved as raw PyTorch/safetensors artifacts. Load the model with the architecture definition used in the training script or port the weights into a compatible pixel decoder implementation.
|
| 56 |
+
|
| 57 |
+
```python
|
| 58 |
+
from safetensors.torch import load_file
|
| 59 |
+
|
| 60 |
+
state_dict = load_file("model.safetensors")
|
| 61 |
+
```
|
| 62 |
+
|
| 63 |
+
## Limitations
|
| 64 |
+
|
| 65 |
+
- PiEa is an experimental pixel decoder, not a full image generation system.
|
| 66 |
+
- It is trained on image reconstruction and denoising, not prompt following.
|
| 67 |
+
- Quality depends on the surrounding pipeline and conditioning signal.
|
| 68 |
+
- The small checkpoint is optimized for throughput and experimentation rather than maximum fidelity.
|
| 69 |
+
- Evaluate on your target image distribution before use.
|
| 70 |
+
|
| 71 |
+
## Citation
|
| 72 |
+
|
| 73 |
+
```bibtex
|
| 74 |
+
@misc{piea2026pixeldecoder,
|
| 75 |
+
title={PiEa: Pixel Diffusion Decoder},
|
| 76 |
+
author={PiEa-ai},
|
| 77 |
+
year={2026},
|
| 78 |
+
url={https://huggingface.co/PiEa-ai/PiEa}
|
| 79 |
+
}
|
| 80 |
+
```
|
config.json
ADDED
|
@@ -0,0 +1,24 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architectures": [
|
| 3 |
+
"PiEaPixelDiffusionDecoder"
|
| 4 |
+
],
|
| 5 |
+
"model_type": "piea_pixel_diffusion_decoder",
|
| 6 |
+
"model_name": "PiEa",
|
| 7 |
+
"manufacturer": "PiEa-ai",
|
| 8 |
+
"input_type": "PiE",
|
| 9 |
+
"pipeline_tag": "image-to-image",
|
| 10 |
+
"image_size": 512,
|
| 11 |
+
"in_channels": 6,
|
| 12 |
+
"out_channels": 3,
|
| 13 |
+
"base_channels": 464,
|
| 14 |
+
"channel_mults": [
|
| 15 |
+
1,
|
| 16 |
+
2,
|
| 17 |
+
4,
|
| 18 |
+
6
|
| 19 |
+
],
|
| 20 |
+
"prediction_type": "epsilon",
|
| 21 |
+
"conditioning": "degraded_image",
|
| 22 |
+
"torch_dtype": "bfloat16",
|
| 23 |
+
"parameter_count": 1010776675
|
| 24 |
+
}
|
eval_comparison_grid.png
ADDED
|
Git LFS Details
|
evaluation_report.json
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model_name": "PiEa",
|
| 3 |
+
"model_dir": "/artifacts/20260528-163638/PiEa",
|
| 4 |
+
"dataset": "huggan/wikiart",
|
| 5 |
+
"num_samples": 8,
|
| 6 |
+
"image_size": 512,
|
| 7 |
+
"sigma": 0.35,
|
| 8 |
+
"mse": 0.0034244786365889013,
|
| 9 |
+
"l1": 0.04037976358085871,
|
| 10 |
+
"psnr": 30.674655300944988,
|
| 11 |
+
"condition_mse": 0.006136163972162952,
|
| 12 |
+
"condition_psnr": 28.14163034902346,
|
| 13 |
+
"comparison_grid": "/artifacts/20260528-163638/PiEa/eval_comparison_grid.png",
|
| 14 |
+
"grid_columns": "clean | degraded_condition | noisy_input | piea_reconstruction | absolute_difference"
|
| 15 |
+
}
|
model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a209eb8e1f20db3026bcc57e67a92bd90ade410133ca7e6969e175749fecc791
|
| 3 |
+
size 4043116796
|
training_report.json
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model_name": "PiEa",
|
| 3 |
+
"repo_id": "PiEa-ai/PiEa",
|
| 4 |
+
"dataset": [
|
| 5 |
+
"huggan/wikiart",
|
| 6 |
+
"huggan/smithsonian_butterflies_subset"
|
| 7 |
+
],
|
| 8 |
+
"run_id": "20260528-163638",
|
| 9 |
+
"model_dir": "/artifacts/20260528-163638/PiEa",
|
| 10 |
+
"parameter_count": 1010776675,
|
| 11 |
+
"train_minutes": 30,
|
| 12 |
+
"steps": 9141,
|
| 13 |
+
"batch_size": 1,
|
| 14 |
+
"image_size": 512,
|
| 15 |
+
"base_channels": 464,
|
| 16 |
+
"channel_mults": [
|
| 17 |
+
1,
|
| 18 |
+
2,
|
| 19 |
+
4,
|
| 20 |
+
6
|
| 21 |
+
],
|
| 22 |
+
"compile_model": false,
|
| 23 |
+
"resume_latest": true,
|
| 24 |
+
"source_checkpoint": "/artifacts/20260528-163440/PiEa",
|
| 25 |
+
"image_tokens": 2396258304,
|
| 26 |
+
"image_tokens_per_second": 1331229.5910597388,
|
| 27 |
+
"target_tokens_per_second": 250000,
|
| 28 |
+
"final_loss": 0.023287300020456314,
|
| 29 |
+
"cached_images": 1024,
|
| 30 |
+
"config": {
|
| 31 |
+
"architectures": [
|
| 32 |
+
"PiEaPixelDiffusionDecoder"
|
| 33 |
+
],
|
| 34 |
+
"model_type": "piea_pixel_diffusion_decoder",
|
| 35 |
+
"model_name": "PiEa",
|
| 36 |
+
"manufacturer": "PiEa-ai",
|
| 37 |
+
"input_type": "PiE",
|
| 38 |
+
"pipeline_tag": "image-to-image",
|
| 39 |
+
"image_size": 512,
|
| 40 |
+
"in_channels": 6,
|
| 41 |
+
"out_channels": 3,
|
| 42 |
+
"base_channels": 464,
|
| 43 |
+
"channel_mults": [
|
| 44 |
+
1,
|
| 45 |
+
2,
|
| 46 |
+
4,
|
| 47 |
+
6
|
| 48 |
+
],
|
| 49 |
+
"prediction_type": "epsilon",
|
| 50 |
+
"conditioning": "degraded_image",
|
| 51 |
+
"torch_dtype": "bfloat16",
|
| 52 |
+
"parameter_count": 1010776675
|
| 53 |
+
}
|
| 54 |
+
}
|