martin-rizzo commited on
Commit
b04e951
·
verified ·
1 Parent(s): 1da6777

docs: Complete README.md for TinyBreaker (prototype1)

Browse files

Expanded README.md with detailed model description for TinyBreaker (prototype1).

Files changed (1) hide show
  1. README.md +31 -1
README.md CHANGED
@@ -11,4 +11,34 @@ tags:
11
  - art
12
  - pixart-sigma
13
  - image
14
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  - art
12
  - pixart-sigma
13
  - image
14
+ ---
15
+
16
+ # TinyBreaker (prototype1)
17
+
18
+
19
+ ## Overview
20
+
21
+ **TinyBreaker** is a hybrid model designed for efficient image generation even on mid and low-end hardware! By integrating the strengths of both PixArt and SD1.5 (Photon) models, TinyBreaker offers an elegant solution that doesn't compromise on quality or performance.
22
+
23
+ ### Key Features
24
+
25
+ - **Hybrid Model Architecture**: Combines base image generation with PixArt and refinement using Photon (or any SD1 model), optimized for minimal parameter use.
26
+ - **Efficient Parameter Use**: A lean 0.6 billion parameters in the base model enable high-quality images without hefty computational demands.
27
+ - **Quick Performance**: Generate stunning images of size 1536×1024 in approximately ~12 seconds on an NVIDIA RTX 3080 GPU, with ongoing efforts to achieve sub-10-second generation times.
28
+ - **High Prompt Adherence**: Ensures generated images are closely aligned with user instructions and expectations due to PixArt model integration.
29
+ - **Optimized Latent Space Handling**: Utilizes Tiny Autoencoders for efficient latent space conversion.
30
+
31
+ ### Current Usage
32
+
33
+ TinyBreaker is currently utilizable via ComfyUI. To use TinyBreaker, you'll need to install custom nodes specific to this model through [ComfyUI-TinyBreaker on GitHub](https://github.com/martin-rizzo/ComfyUI-TinyBreaker).
34
+
35
+ Note: The current "Prototype1" version of TinyBreaker uses PixArt Sigma 1024 in combination with Photon (SD1.5) without additional training or fine-tuning. In the future, if I have the resources, I plan to train both models together to generate images of even higher quality.
36
+
37
+ ## Limitations
38
+
39
+ - **Text Generation**: Generating legible text within images is a challenge due to PixArt's training limitations. Enhancements in this area may require extensive retraining.
40
+
41
+ ## Future Directions
42
+
43
+ I'm dedicated to enhancing TinyBreaker's speed and accessibility, particularly for users with mid-range or lower-end hardware setups. Look forward to future updates as I work on enhancing TinyBreaker's capabilities.
44
+