Text-to-Image
Transformers
Safetensors
Hunyuan
text-generation
hunyuan
quantization
nf4
comfyui
custom-nodes
autoregressive
DiT
HunyuanImage-3.0
instruct
image-editing
bitsandbytes
4bit
distilled
custom_code
4-bit precision
Instructions to use EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2 with Transformers:
# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Optimize single image processing speed in eager mode with think_recaption mode
4
#3 opened 2 months ago
by
pa443326
AssertionError: assert module.weight.shape[1] == 1 in fix_4bit_weight_quant_state_from_module during first inference step
#2 opened 3 months ago
by
KeizoMiyazawa
Is there a way to use this model by diffusers or vllm?
1
#1 opened 3 months ago
by
chaoran0522