README.md

---
license: other
license_name: ideogram-4-non-commercial
license_link: https://huggingface.co/ideogram-ai/ideogram-4-fp8/blob/main/LICENSE.md
tags:
  - text-to-image
  - lora
  - diffusers
base_model: ideogram-ai/ideogram-4-fp8

---
# Ideogram 4 Unconditional LoRA

This is a LoRA that was initialized by extracting the difference of the Ideogram 4 conditional and unconditional model weights. 
It was further tuned using student teacher training on real data and a loss was performed on a per layer basis to more closely
match the unconditional model. This can be used on the conditional Ideogram 4 model during the unconditional pass 
as a replacement to the full 9B paramiter unconditional model. 

Using the full unconditional model will likely yield better results, but this will work as a light weight alternative. It was 
originally trained to be used in [Ostris AI Toolkit](https://github.com/ostris/ai-toolkit) so samples would be more in line 
with what the full pipeline would produce without needing to load the entire unconditional model.