barnamemaker
/

Text-to-Video
GGUF
English
hyvid
lora
gguf-comfy
gguf-node
File size: 5,229 Bytes
dcf31dc
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
---
license: mit
license_name: tencent-hunyuan-community
license_link: LICENSE
datasets:
- trojblue/test-HunyuanVideo-anime-images
- calcuis/anime-descriptor
language:
- en
base_model:
- tencent/HunyuanVideo
- trojblue/HunyuanVideo-lora-AnimeShots
pipeline_tag: text-to-video
tags:
- hyvid
- lora
- gguf-comfy
- gguf-node
widget:
- text: >-
    anime style anime girl with massive fennec ears and one big fluffy tail, she
    has blonde long hair blue eyes wearing a maid outfit with a long black gold
    leaf pattern dress, walking slowly to the front with sweetie smile, holding
    a fancy black forest cake with candles on top in the kitchen of an old dark
    Victorian mansion lit by candlelight with a bright window to the foggy
  output:
    url: samples\ComfyUI_00007_.webp
- text: >-
    anime scene of a vibrant carnival with colorful rides, games, and food
    stalls, and a cute anime girl with multicolored hair, holding a melting
    ice-cream, wearing a fluffy white hoodie and blue mini shorts, winking her
    eye, smiling to the camera
  output:
    url: samples\ComfyUI_00002_.webp
- text: >-
    anime girl with pink twin tails and green eyes, wearing a school uniform,
    holding a stack of books in a bustling library filled with sunlight
    streaming through tall windows
  output:
    url: samples\ComfyUI_00001_.webp
- text: >-
    anime boy with silver hair and blue eyes, wearing a casual hoodie, sitting
    on a park bench, feeding pigeons with a gentle smile
  output:
    url: samples\ComfyUI_00003_.webp
- text: >-
    anime style anime girl with massive fennec ears and one big fluffy tail, she
    has blonde long hair blue eyes wearing a maid outfit with a long black gold
    leaf pattern dress, walking slowly to the front with sweetie smile, holding
    a fancy black forest cake with candles on top in the kitchen of an old dark
    Victorian mansion lit by candlelight with a bright window to the foggy
    forest
  output:
    url: samples\ComfyUI_00004_.webp
- text: >-
    anime style anime girl with massive fennec ears and one big fluffy tail, she
    has blonde hair long hair blue eyes wearing a pink sweater and a long blue
    skirt walking in a beautiful outdoor scenery with snow mountains in the
    background
  output:
    url: samples\ComfyUI_00005_.webp
---

# **GGUF quantized and fp8 scaled version of hyvid with lora anime adapter**

<Gallery />

![screenshot](https://raw.githubusercontent.com/calcuis/comfy/master/hyvid.gif)

## **setup (once)**
- drag hyvid_lora_adapter.safetensors [[323MB](https://huggingface.co/calcuis/hyvid/blob/main/hyvid_lora_adapter.safetensors)] to > ./ComfyUI/models/loras
- drag hunyuan-video-t2v-720p-q4_0.gguf [[7.74GB](https://huggingface.co/calcuis/hyvid/blob/main/hunyuan-video-t2v-720p-q4_0.gguf)] to > ./ComfyUI/models/diffusion_models
- drag llava_llama3-q4_0.gguf [[4.68GB](https://huggingface.co/calcuis/hyvid/blob/main/llava_llama3-q4_0.gguf)] to > ./ComfyUI/models/text_encoders
- drag clip_l_fp8_e4m3fn.safetensors [[123MB](https://huggingface.co/calcuis/hyvid/blob/main/clip_l_fp8_e4m3fn.safetensors)] to > ./ComfyUI/models/text_encoders
- drag hunyuan_video_vae_fp8_e4m3fn.safetensors [[247MB](https://huggingface.co/calcuis/hyvid/blob/main/hunyuan_video_vae_fp8_e4m3fn.safetensors)] to > ./ComfyUI/models/vae

## **run it straight (no installation needed way)**
- run the .bat file in the main directory (assuming you are using the gguf-node pack below)
- drag the demo [clip](https://huggingface.co/calcuis/hyvid/blob/main/samples%5CComfyUI_00007_.webp) or the workflow json file (below) to > your browser

### **workflows**
- example workflow for [gguf](https://huggingface.co/calcuis/hyvid/blob/main/workflow-hyvid-gguf.json) (upgrade your [node](https://github.com/calcuis/gguf) for llava gguf support; more quantized llava-llama3 version [here](https://huggingface.co/chatpig/llava-llama3/tree/main))
- example workflow for [safetensors](https://huggingface.co/calcuis/hyvid/blob/main/workflow-hyvid-safetensors.json) (fp8 scaled version [[13.2GB](https://huggingface.co/calcuis/hyvid/blob/main/hunyuan_video_t2v_720_fp8_scaled.safetensors)] is recommended)

### **review**
- more stable output if adapter applied
- working good even with fp8_e4m3fn scaled clip and vae
- significant changes in loading speed while using the new quantized/scaled file(s) with revised workflow (see above)

### **references**
- lora adapter from [trojblue](https://huggingface.co/trojblue/HunyuanVideo-lora-AnimeShots)
- base model from [tencent](https://huggingface.co/tencent/HunyuanVideo)
- fast model from [fastvideo](https://huggingface.co/FastVideo/FastHunyuan)
- comfyui from [comfyanonymous](https://github.com/comfyanonymous/ComfyUI)
- comfyui-gguf [city96](https://github.com/city96/ComfyUI-GGUF)
- gguf-comfy [pack](https://github.com/calcuis/gguf-comfy/releases)
- gguf-node ([pypi](https://pypi.org/project/gguf-node)|[repo](https://github.com/calcuis/gguf)|[pack](https://github.com/calcuis/gguf/releases))

### **appendices**
- get more test prompt from the training [dataset](https://huggingface.co/datasets/calcuis/anime-descriptor)
- still no ideas? get fresh prompt from our [simulator](https://prompt.calcuis.us)