import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("muverqqw/DreamCoil-Spectra", dtype=torch.bfloat16, device_map="cuda")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]DreamCoil Spectra: The Next Generation of Aesthetic Diffusion
DreamCoil Spectra represents a landmark shift in the DreamCoil ecosystem, developed by IceL1ghtning(muverqqw). This model marks our transition from the traditional U-Net structures of the SDXL era to a high-performance Diffusion Transformer (DiT) backbone, utilizing the Z-Image architecture.
Spectra has been meticulously trained to inherit and refine the iconic, ethereal, and minimalist aesthetic of the original DreamCoil Family, delivering superior structural integrity and artistic coherence.
π Key Improvements & Architectural Evolution
1. The Power of Diffusion Transformers (DiT)
By moving to a Z-Image (DiT) base, Spectra overcomes many limitations of previous convolutional models:
- Superior Spatial Intelligence: The self-attention mechanism ensures that anatomy and complex compositions remain consistent across the entire canvas.
- Contextual Depth: Transformers process prompts with a deeper "understanding" of relational keywords, resulting in significantly better prompt adherence.
- Global Cohesion: Unlike U-Nets that process images in blocks, DiT treats the entire latent space as a sequence, leading to more harmonious color transitions and lighting.
2. Preserving the "DreamCoil" Legacy
Despite the change in architecture, we have gone to great lengths to ensure the soul of the series remains intact. Spectra specializes in:
- Ethereal Minimalism: Clean backgrounds and soft, purposeful color palettes.
- Advanced Character Design: Vibrant, stylized hair (like the signature pink hues) and expressive, clean-line facial features.
- Artistic Versatility: From minimalist vector-style art to dream-like, atmospheric landscapes.
3. T4/P100 Optimization (The Custom Pipeline)
One of the biggest challenges with DiT models is their resource consumption. IceLightning has developed a specialized Custom Inference Pipeline to make this model accessible to everyone:
- VRAM Efficiency: Specifically tuned to run on NVIDIA Tesla T4 (Google Colab) and P100 (Kaggle) without crashing.
- Memory Offloading: The pipeline manages weight loading dynamically to keep the peak memory footprint below 12GB during high-resolution generation.
π Getting Started (Custom Pipeline)
To take full advantage of the memory optimizations and the Z-Image architecture, use the custom handler included in this repository.
Installation
pip install torch torchvision diffusers transformers accelerate
Inference Script
import torch
from diffusers import DiffusionPipeline
# Load the model with the specialized DreamCoil Spectra Pipeline
model_id = "muverqqw/DreamCoil-Spectra"
pipe = DiffusionPipeline.from_pretrained(
model_id,
custom_pipeline="muverqqw/DreamCoil-Spectra", # Optimized for T4/P100 stability
torch_dtype=torch.float16,
use_safetensors=True
)
pipe.to("cuda")
# Recommended for users with 16GB VRAM or less (T4/P100)
pipe.enable_model_cpu_offload()
pipe.enable_vae_tiling()
prompt = "your positive prompt here"
negative_prompt = "your negative prompt here"
image = pipe(
prompt=prompt,
negative_prompt=negative_prompt,
num_inference_steps=30,
guidance_scale=7.0,
width=1024,
height=1024
).images[0]
image.save("spectra_masterpiece.png")
π¨ Recommended Settings
Native Resolution: 1024x1024 or 768x1152.
Aspect Ratios: Supports 16:9 and 9:16 due to the flexible nature of DiT.
Sampler: Simple.
Steps: 8-9.
CFG Scale: 1.0.
π The DreamCoil Ecosystem
If you are looking for our previous Stable Diffusion XL based models, you can find them here:
DreamCoil v1.0 (SDXL) β The pinnacle of our U-Net based series.
DreamCoil Collection β Explore Checkpoints.
βοΈ License & Credits
DreamCoil Spectra was created and fine-tuned by IceL1ghtning (@muverqqw).
This model is released under the Apache-2.0 license.
- Downloads last month
- 182
Model tree for muverqqw/DreamCoil-Spectra
Base model
Tongyi-MAI/Z-Image