docs: Complete README.md for TinyBreaker (prototype1)
Browse filesExpanded README.md with detailed model description for TinyBreaker (prototype1).
README.md
CHANGED
|
@@ -11,4 +11,34 @@ tags:
|
|
| 11 |
- art
|
| 12 |
- pixart-sigma
|
| 13 |
- image
|
| 14 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
- art
|
| 12 |
- pixart-sigma
|
| 13 |
- image
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# TinyBreaker (prototype1)
|
| 17 |
+
|
| 18 |
+
|
| 19 |
+
## Overview
|
| 20 |
+
|
| 21 |
+
**TinyBreaker** is a hybrid model designed for efficient image generation even on mid and low-end hardware! By integrating the strengths of both PixArt and SD1.5 (Photon) models, TinyBreaker offers an elegant solution that doesn't compromise on quality or performance.
|
| 22 |
+
|
| 23 |
+
### Key Features
|
| 24 |
+
|
| 25 |
+
- **Hybrid Model Architecture**: Combines base image generation with PixArt and refinement using Photon (or any SD1 model), optimized for minimal parameter use.
|
| 26 |
+
- **Efficient Parameter Use**: A lean 0.6 billion parameters in the base model enable high-quality images without hefty computational demands.
|
| 27 |
+
- **Quick Performance**: Generate stunning images of size 1536×1024 in approximately ~12 seconds on an NVIDIA RTX 3080 GPU, with ongoing efforts to achieve sub-10-second generation times.
|
| 28 |
+
- **High Prompt Adherence**: Ensures generated images are closely aligned with user instructions and expectations due to PixArt model integration.
|
| 29 |
+
- **Optimized Latent Space Handling**: Utilizes Tiny Autoencoders for efficient latent space conversion.
|
| 30 |
+
|
| 31 |
+
### Current Usage
|
| 32 |
+
|
| 33 |
+
TinyBreaker is currently utilizable via ComfyUI. To use TinyBreaker, you'll need to install custom nodes specific to this model through [ComfyUI-TinyBreaker on GitHub](https://github.com/martin-rizzo/ComfyUI-TinyBreaker).
|
| 34 |
+
|
| 35 |
+
Note: The current "Prototype1" version of TinyBreaker uses PixArt Sigma 1024 in combination with Photon (SD1.5) without additional training or fine-tuning. In the future, if I have the resources, I plan to train both models together to generate images of even higher quality.
|
| 36 |
+
|
| 37 |
+
## Limitations
|
| 38 |
+
|
| 39 |
+
- **Text Generation**: Generating legible text within images is a challenge due to PixArt's training limitations. Enhancements in this area may require extensive retraining.
|
| 40 |
+
|
| 41 |
+
## Future Directions
|
| 42 |
+
|
| 43 |
+
I'm dedicated to enhancing TinyBreaker's speed and accessibility, particularly for users with mid-range or lower-end hardware setups. Look forward to future updates as I work on enhancing TinyBreaker's capabilities.
|
| 44 |
+
|