Text-to-Image
Transformers
Safetensors
Hunyuan
text-generation
hunyuan
quantization
nf4
comfyui
custom-nodes
autoregressive
DiT
HunyuanImage-3.0
instruct
image-editing
bitsandbytes
4bit
distilled
custom_code
4-bit precision
Instructions to use EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2 with Transformers:
# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Looking for LoRA fine-tuning frameworks for HunyuanImage 3.0
1
#5 opened 27 days ago
by
lucyyccz
How to get it to work? Any directions appreciated!
1
#4 opened about 1 month ago
by
TobbeBobbe2346235425643
AssertionError: assert module.weight.shape[1] == 1 in fix_4bit_weight_quant_state_from_module during first inference step
#2 opened 4 months ago
by
KeizoMiyazawa
Is there a way to use this model by diffusers or vllm?
1
#1 opened 5 months ago
by
chaoran0522