masoudc commited on
Commit
b0ebbda
·
verified ·
1 Parent(s): 549058b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -10
README.md CHANGED
@@ -20,15 +20,10 @@ pipeline_tag: text-to-image
20
  # Nitro-E · WikiArt Themes & Feelings (EMA-aligned)
21
 
22
  A LoRA post-training of **[amd/Nitro-E](https://huggingface.co/amd/Nitro-E)** (304M E-MMDiT,
23
- flow-matching, MIT) that renders subjects in fine-art styles conditioned on **art movement +
24
- genre + emotion/theme**. This repo holds the **EMA-aligned, merged, serveable** checkpoint
25
  (`nitro_cc_ema_merged.safetensors`) plus the LoRA adapter it was merged from.
26
 
27
- The **EMA** (exponential moving average over the LoRA weights, rate 0.9999) is the key fix:
28
- a rank-16 LoRA on ~29k images overfits within a couple thousand steps and the raw weights
29
- collapse to noise past the knee; the EMA-averaged weights stay coherent. This is the
30
- checkpoint served in the live demo.
31
-
32
  - **Base:** `amd/Nitro-E` (Nitro-E-512px), text encoder `meta-llama/Llama-3.2-1B` (gated), VAE `mit-han-lab/dc-ae-f32c32-sana-1.0`.
33
  - **Resolution:** 512x512. **License:** MIT (base) — see data notes below.
34
  - **Tracking:** [https://wandb.ai/imaging-ai/more-art-than-science](https://wandb.ai/imaging-ai/more-art-than-science)
@@ -38,8 +33,7 @@ checkpoint served in the live demo.
38
  - `adapter_config.json` + `adapter_model.safetensors` — the PEFT LoRA adapter (apply on top of `amd/Nitro-E` if you prefer not to use the merged weights).
39
 
40
  ## Training data
41
- [`emotiongoes/wikiart-themes-feelings`](https://huggingface.co/datasets/emotiongoes/wikiart-themes-feelings)
42
- — 32,061 WikiArt works (metadata + image URLs). ~29,000 images were downloadable and
43
  used. The `consolidated-caption` field carries the emotional/style signal used as the prompt.
44
 
45
  ## Recipe
@@ -60,4 +54,4 @@ Example prompt: `"a tranquil river landscape, in the style of Impressionism, evo
60
  - Inherits Nitro-E 304M quality ceiling; can overfit WikiArt style cues.
61
  - Requires gated `meta-llama/Llama-3.2-1B` access to run.
62
  - **Data rights:** trained on WikiArt images but does not redistribute them; the dataset is
63
- metadata-only. Many works are public domain but not all use outputs accordingly.
 
20
  # Nitro-E · WikiArt Themes & Feelings (EMA-aligned)
21
 
22
  A LoRA post-training of **[amd/Nitro-E](https://huggingface.co/amd/Nitro-E)** (304M E-MMDiT,
23
+ flow-matching, MIT) from AMD Brain that renders subjects in fine-art styles conditioned on art movement, genre, emotion and theme.
24
+ This repo holds the EMA-aligned, merged, serveable checkpoint
25
  (`nitro_cc_ema_merged.safetensors`) plus the LoRA adapter it was merged from.
26
 
 
 
 
 
 
27
  - **Base:** `amd/Nitro-E` (Nitro-E-512px), text encoder `meta-llama/Llama-3.2-1B` (gated), VAE `mit-han-lab/dc-ae-f32c32-sana-1.0`.
28
  - **Resolution:** 512x512. **License:** MIT (base) — see data notes below.
29
  - **Tracking:** [https://wandb.ai/imaging-ai/more-art-than-science](https://wandb.ai/imaging-ai/more-art-than-science)
 
33
  - `adapter_config.json` + `adapter_model.safetensors` — the PEFT LoRA adapter (apply on top of `amd/Nitro-E` if you prefer not to use the merged weights).
34
 
35
  ## Training data
36
+ — A private dataset of 32,061 WikiArt works (metadata + image URLs). ~29,000 images were downloadable and
 
37
  used. The `consolidated-caption` field carries the emotional/style signal used as the prompt.
38
 
39
  ## Recipe
 
54
  - Inherits Nitro-E 304M quality ceiling; can overfit WikiArt style cues.
55
  - Requires gated `meta-llama/Llama-3.2-1B` access to run.
56
  - **Data rights:** trained on WikiArt images but does not redistribute them; the dataset is
57
+ metadata-only. Many works are public domain but not all so use outputs accordingly.