| | --- |
| | license: mit |
| | license_name: tencent-hunyuan-community |
| | license_link: LICENSE |
| | datasets: |
| | - trojblue/test-HunyuanVideo-anime-images |
| | - calcuis/anime-descriptor |
| | language: |
| | - en |
| | base_model: |
| | - tencent/HunyuanVideo |
| | - trojblue/HunyuanVideo-lora-AnimeShots |
| | pipeline_tag: text-to-video |
| | tags: |
| | - hyvid |
| | - lora |
| | - gguf-comfy |
| | - gguf-node |
| | widget: |
| | - text: >- |
| | anime style anime girl with massive fennec ears and one big fluffy tail, she |
| | has blonde long hair blue eyes wearing a maid outfit with a long black gold |
| | leaf pattern dress, walking slowly to the front with sweetie smile, holding |
| | a fancy black forest cake with candles on top in the kitchen of an old dark |
| | Victorian mansion lit by candlelight with a bright window to the foggy |
| | output: |
| | url: samples\ComfyUI_00007_.webp |
| | - text: >- |
| | anime scene of a vibrant carnival with colorful rides, games, and food |
| | stalls, and a cute anime girl with multicolored hair, holding a melting |
| | ice-cream, wearing a fluffy white hoodie and blue mini shorts, winking her |
| | eye, smiling to the camera |
| | output: |
| | url: samples\ComfyUI_00002_.webp |
| | - text: >- |
| | anime girl with pink twin tails and green eyes, wearing a school uniform, |
| | holding a stack of books in a bustling library filled with sunlight |
| | streaming through tall windows |
| | output: |
| | url: samples\ComfyUI_00001_.webp |
| | - text: >- |
| | anime boy with silver hair and blue eyes, wearing a casual hoodie, sitting |
| | on a park bench, feeding pigeons with a gentle smile |
| | output: |
| | url: samples\ComfyUI_00003_.webp |
| | - text: >- |
| | anime style anime girl with massive fennec ears and one big fluffy tail, she |
| | has blonde long hair blue eyes wearing a maid outfit with a long black gold |
| | leaf pattern dress, walking slowly to the front with sweetie smile, holding |
| | a fancy black forest cake with candles on top in the kitchen of an old dark |
| | Victorian mansion lit by candlelight with a bright window to the foggy |
| | forest |
| | output: |
| | url: samples\ComfyUI_00004_.webp |
| | - text: >- |
| | anime style anime girl with massive fennec ears and one big fluffy tail, she |
| | has blonde hair long hair blue eyes wearing a pink sweater and a long blue |
| | skirt walking in a beautiful outdoor scenery with snow mountains in the |
| | background |
| | output: |
| | url: samples\ComfyUI_00005_.webp |
| | --- |
| | |
| | # **GGUF quantized and fp8 scaled version of hyvid with lora anime adapter** |
| |
|
| | <Gallery /> |
| |
|
| |  |
| |
|
| | ## **setup (once)** |
| | - drag hyvid_lora_adapter.safetensors [[323MB](https://huggingface.co/calcuis/hyvid/blob/main/hyvid_lora_adapter.safetensors)] to > ./ComfyUI/models/loras |
| | - drag hunyuan-video-t2v-720p-q4_0.gguf [[7.74GB](https://huggingface.co/calcuis/hyvid/blob/main/hunyuan-video-t2v-720p-q4_0.gguf)] to > ./ComfyUI/models/diffusion_models |
| | - drag llava_llama3-q4_0.gguf [[4.68GB](https://huggingface.co/calcuis/hyvid/blob/main/llava_llama3-q4_0.gguf)] to > ./ComfyUI/models/text_encoders |
| | - drag clip_l_fp8_e4m3fn.safetensors [[123MB](https://huggingface.co/calcuis/hyvid/blob/main/clip_l_fp8_e4m3fn.safetensors)] to > ./ComfyUI/models/text_encoders |
| | - drag hunyuan_video_vae_fp8_e4m3fn.safetensors [[247MB](https://huggingface.co/calcuis/hyvid/blob/main/hunyuan_video_vae_fp8_e4m3fn.safetensors)] to > ./ComfyUI/models/vae |
| | |
| | ## **run it straight (no installation needed way)** |
| | - run the .bat file in the main directory (assuming you are using the gguf-node pack below) |
| | - drag the demo [clip](https://huggingface.co/calcuis/hyvid/blob/main/samples%5CComfyUI_00007_.webp) or the workflow json file (below) to > your browser |
| | |
| | ### **workflows** |
| | - example workflow for [gguf](https://huggingface.co/calcuis/hyvid/blob/main/workflow-hyvid-gguf.json) (upgrade your [node](https://github.com/calcuis/gguf) for llava gguf support; more quantized llava-llama3 version [here](https://huggingface.co/chatpig/llava-llama3/tree/main)) |
| | - example workflow for [safetensors](https://huggingface.co/calcuis/hyvid/blob/main/workflow-hyvid-safetensors.json) (fp8 scaled version [[13.2GB](https://huggingface.co/calcuis/hyvid/blob/main/hunyuan_video_t2v_720_fp8_scaled.safetensors)] is recommended) |
| | |
| | ### **review** |
| | - more stable output if adapter applied |
| | - working good even with fp8_e4m3fn scaled clip and vae |
| | - significant changes in loading speed while using the new quantized/scaled file(s) with revised workflow (see above) |
| |
|
| | ### **references** |
| | - lora adapter from [trojblue](https://huggingface.co/trojblue/HunyuanVideo-lora-AnimeShots) |
| | - base model from [tencent](https://huggingface.co/tencent/HunyuanVideo) |
| | - fast model from [fastvideo](https://huggingface.co/FastVideo/FastHunyuan) |
| | - comfyui from [comfyanonymous](https://github.com/comfyanonymous/ComfyUI) |
| | - comfyui-gguf [city96](https://github.com/city96/ComfyUI-GGUF) |
| | - gguf-comfy [pack](https://github.com/calcuis/gguf-comfy/releases) |
| | - gguf-node ([pypi](https://pypi.org/project/gguf-node)|[repo](https://github.com/calcuis/gguf)|[pack](https://github.com/calcuis/gguf/releases)) |
| |
|
| | ### **appendices** |
| | - get more test prompt from the training [dataset](https://huggingface.co/datasets/calcuis/anime-descriptor) |
| | - still no ideas? get fresh prompt from our [simulator](https://prompt.calcuis.us) |
