|
|
--- |
|
|
library_name: diffusers |
|
|
license: apache-2.0 |
|
|
base_model: |
|
|
- neta-art/Neta-Lumina |
|
|
tags: |
|
|
- diffusers, |
|
|
- text-to-image |
|
|
--- |
|
|
|
|
|
# Neta Lumina v1.0 for diffusers library |
|
|
|
|
|
[**Neta Lumina Tech Report**](https://neta.art/blog/neta_lumina/) |
|
|
|
|
|
## 📽️ Flash Preview |
|
|
|
|
|
<video controls autoplay loop muted playsinline style="max-width:100%; border-radius:8px;"> |
|
|
<source src="https://pages-r2.neta.art/Neta_Lumina_Flash_PV.webm" type="video/webm" /> |
|
|
Your browser does not support the video tag. |
|
|
</video> |
|
|
|
|
|
# Introduction |
|
|
|
|
|
**Neta Lumina** is a high‑quality anime‑style image‑generation model developed by Neta.art Lab. |
|
|
Building on the open‑source **Lumina‑Image‑2.0** released by the Alpha‑VLLM team at Shanghai AI Laboratory, we fine‑tuned the model with a vast corpus of high‑quality anime images and multilingual tag data. The preliminary result is a compelling model with powerful comprehension and interpretation abilities (thanks to Gemma text encoder), ideal for illustration, posters, storyboards, character design, and more. |
|
|
|
|
|
## Key Features |
|
|
|
|
|
- Optimized for diverse creative scenarios such as Furry, Guofeng (traditional‑Chinese aesthetics), pets, etc. |
|
|
- Wide coverage of characters and styles, from popular to niche concepts. (Still support danbooru tags!) |
|
|
- Accurate natural‑language understanding with excellent adherence to complex prompts. |
|
|
- Native multilingual support, with Chinese, English, and Japanese recommended first. |
|
|
|
|
|
## Model Versions |
|
|
|
|
|
For models in alpha tests, requst access at https://huggingface.co/neta-art/NetaLumina_Alpha if you are interested. We will keep updating. |
|
|
|
|
|
### neta-lumina-v1.0 |
|
|
|
|
|
- **Official Release**: overall best performance |
|
|
|
|
|
|
|
|
### neta-lumina-beta-0624-raw (archived) |
|
|
|
|
|
- **Primary Goal**: General knowledge and anime‑style optimization |
|
|
- **Data Set**: >13 million anime‑style images |
|
|
- **>46,000** A100 Hours |
|
|
- Higher upper limit, suitable for pro users. Check [**Neta Lumina Prompt Book**](https://nieta-art.feishu.cn/wiki/RY3GwpT59icIQlkWXEfcCqIMnQd) for better results. |
|
|
|
|
|
### neta-lumina-beta-0624-aes-experimental (archived) |
|
|
|
|
|
- First beta release candidate |
|
|
- **Primary Goal**: Enhanced aesthetics, pose accuracy, and scene detail |
|
|
- **Data Set**: Hundreds of thousands of handpicked high‑quality anime images (fine‑tuned on an older version of raw model) |
|
|
- User-friendly, suitable for most people. |
|
|
<br> |
|
|
|
|
|
# How to Use |
|
|
|
|
|
[Try it at Hugging Face playground](https://huggingface.co/spaces/neta-art/NetaLumina_T2I_Playground) |
|
|
|
|
|
## Or use it with diffusers: |
|
|
```python |
|
|
import torch |
|
|
from diffusers import Lumina2Pipeline |
|
|
|
|
|
pipe = Lumina2Pipeline.from_pretrained("VirtualAddressExtension/Neta-Lumina-v1.0-diffusers", torch_dtype=torch.bfloat16) |
|
|
pipe.enable_model_cpu_offload() #save some VRAM by offloading the model to CPU. Remove this if you have enough GPU power |
|
|
|
|
|
prompt = "You are an assistant designed to generate anime images based on textual prompts. <Prompt Start> neta, @quasarcake, 1girl, solo, 1girl,solo,bangs,black hair,purple eyes,pink hair,purple hair,multicolored hair,virtual youtuber,hair bun,streaked hair,double bun, school uniform, white shirt, pleated skirt, gentle smile, looking at viewer, sitting, upper body, close-up, soft lighting, depth of field, cherry blossom background, warm lighting, best quality" |
|
|
image = pipe( |
|
|
prompt, |
|
|
height=1024, |
|
|
width=1024, |
|
|
guidance_scale=4.0, |
|
|
num_inference_steps=50, |
|
|
cfg_trunc_ratio=0.25, |
|
|
cfg_normalization=True, |
|
|
generator=torch.Generator("cpu").manual_seed(0) |
|
|
).images[0] |
|
|
image.save("lumina_demo.png") |
|
|
``` |
|
|
|
|
|
# Prompt Book |
|
|
|
|
|
Detailed prompt guidelines: [**Neta Lumina Prompt Book**](https://neta.art/blog/neta_lumina_prompt_book/) |
|
|
<br> |
|
|
|
|
|
# Community |
|
|
|
|
|
- Discord: https://discord.com/invite/TTTGccjbEa |
|
|
- QQ group: 1039442542 |
|
|
<br> |
|
|
|
|
|
# Roadmap |
|
|
|
|
|
## Model |
|
|
|
|
|
- Continous base‑model training to raise reasoning capability. |
|
|
- Aesthetic‑dataset iteration to improve anatomy, background richness, and overall appealness. |
|
|
- Smarter, more versatile tagging tools to lower the creative barrier. |
|
|
|
|
|
## Ecosystem |
|
|
|
|
|
- LoRA training tutorials and components |
|
|
- Experienced users may already fine‑tune via Lumina‑Image‑2.0’s open code. |
|
|
- Development of advanced control / style‑consistency features (e.g., [Omini Control](https://arxiv.org/pdf/2411.15098)). [**Call for Collaboration!**](https://discord.com/invite/TTTGccjbEa) |
|
|
<br> |
|
|
|
|
|
# License & Disclaimer |
|
|
|
|
|
- Neta Lumina is released under [**Apache License 2.0**](https://www.apache.org/licenses/LICENSE-2.0) |
|
|
<br> |
|
|
|
|
|
# Participants & Contributors |
|
|
|
|
|
- Special thanks to the **Alpha‑VLLM** team for open‑sourcing **Lumina‑Image‑2.0** |
|
|
- **Model development**: **Neta.art Lab (Civitai)** |
|
|
- Core Trainer: **li_li** [Civitai](https://civitai.com/user/li_li) ・ [Hugging Face](https://huggingface.co/heziiiii) |
|
|
<br> |
|
|
- **Partners** |
|
|
- **nebulae**: [Civitai](https://civitai.com/user/kitarz) ・ [Hugging Face](https://huggingface.co/NebulaeWis) |
|
|
- **生姜**: [Hugging Face](https://huggingface.co/ssj0021) |
|
|
- **孙一** |
|
|
- [**narugo1992**](https://github.com/narugo1992) & [**deepghs**](https://huggingface.co/deepghs): open datasets, processing tools, and models |
|
|
- [**Naifu**](https://github.com/Mikubill/naifu) trainer at [Mikubill](https://github.com/Mikubill) |
|
|
<br> |
|
|
|
|
|
# Community Contributors |
|
|
|
|
|
- **Evaluators & developers**: [二小姐](https://huggingface.co/Second222), [spawner](https://github.com/spawner1145), [Rnglg2](https://civitai.com/user/Rnglg2) |
|
|
- **Other contributors**: [沉迷摸鱼](https://www.pixiv.net/users/22433944), [poi](https://x.com/poi______1), AshenWitch, [十分无奈](https://www.pixiv.net/users/15750592), [GHOSTLX](https://civitai.com/user/ghostlxh), [wenaka](https://civitai.com/user/Wenaka_), [iiiiii](https://civitai.com/user/Blueberries_i), [年糕特工队](https://x.com/gaonian2331), [恩匹希](https://civitai.com/user/NPCde), 奶冻, [mumu](https://civitai.com/user/mumu520), [yizyin](https://civitai.com/user/yizyin), smile, Yang, 古神, 灵之药, [LyloGummy](https://civitai.com/user/LyloGummy), 雪时 |
|
|
<br> |
|
|
|
|
|
# Appendix & Resources |
|
|
|
|
|
- **TeaCache**: https://github.com/spawner1145/CUI-Lumina2-TeaCache |
|
|
- **Advanced samplers & TeaCache guide (by spawner)**: https://docs.qq.com/doc/DZEFKb1ZrZVZiUmxw?nlc=1 |
|
|
- **Neta Lumina ComfyUI Manual (in Chinese)**: https://docs.qq.com/doc/DZEVQZFdtaERPdXVh |
|
|
|
