LingBot_ComfyUI / README.md
realrebelai's picture
Update README.md
65ede0d verified
|
Raw
History Blame Contribute Delete
3.22 kB
---
license: other
license_name: lingbot-video-license
license_link: https://huggingface.co/robbyant/lingbot-video-dense-1.3b
base_model: robbyant/lingbot-video-dense-1.3b
library_name: diffusers
tags:
- f16
- video
- text-to-video
- image-to-video
- comfyui
- wan-vae
- qwen3-vl
- low-vram
- quantization
---
# LingBot-Video-Dense-1.3B β€” ComfyUI repack (single-file, 8GB-VRAM ready)
<div align="center">
<video
src="https://cdn-uploads.huggingface.co/production/uploads/68761990332d15464ccc8dee/4c5xvrkNvb1Nde1xUK1Eu.mp4"
width="400"
height="400"
autoplay
loop
muted
playsinline
></video>
</div>
<div align="center">
<video
src="https://cdn-uploads.huggingface.co/production/uploads/68761990332d15464ccc8dee/yNFPaS5D-dPPVMJdqiTTb.mp4"
width="400"
height="400"
autoplay
loop
muted
playsinline
></video>
</div>
## UPDATE! - added a prompt rebuilder node to satisfy the models need for a VERY strict json structure. this is not normal json, its what i like to call "LingBot" json prompting as its alot more in depth. try it out!
Repackaged weights of [robbyant/lingbot-video-dense-1.3b](https://huggingface.co/robbyant/lingbot-video-dense-1.3b)
for use with the **[ComfyUI_Rebels_LingBot](https://github.com/RealRebelAI/ComfyUI_Rebels_LingBot)**
node pack. No weight modification β€” the original diffusers shards are merged/renamed into
single files for ComfyUI's model folders. All configs ship inside the node pack.
Runs T2V and TI2V on an **RTX 3070 8GB / 16GB RAM**: the Qwen3-VL encoder is loaded on
CPU, used, and freed before the 1.3B DiT (2.79GB bf16, fully VRAM-resident) starts.
## Files
| File | Put in | Size |
|---|---|---|
| `LingBot_1.3b_DiT.safetensors` | `ComfyUI/models/diffusion_models/` | ~2.8 GB |
| `LingBot_text-encoder.safetensors` | `ComfyUI/models/text_encoders/` | ~8 GB |
| `LingBot_vae.safetensors` | `ComfyUI/models/vae/` | ~0.5 GB |
The text encoder is the repo's Qwen3-VL, shards merged into one file (bit-identical
tensors). `lm_head.weight` is intentionally absent β€” it is tied to `embed_tokens`; the
node pack re-ties it at load.
## Recommended settings
- **832Γ—480**, up to **81 frames**, 40 steps, shift 3.0
- guidance **3.0** (t2v) / **~3.0** (TI2V β€” higher burns color on image runs)
- export at **24 fps**
- VAE tiling **off** unless you must (temporal color/exposure drift on long clips)
~14 s/it on a 3070 at the settings above (sequential CFG); β‰ˆ10 minutes per 81-frame clip.
## Notes & limitations
- The trained window is 81 frames; longer generations collapse.
- Square/other aspect ratios are out-of-distribution (letterboxing artifacts) β€” stay at 832Γ—480.
- 1.3B-class video: modest motion complexity; rendered text (signs/labels) is not legible.
- TI2V requires the image to be fed to **both** the encode node (vision conditioning) and
the sampler (first-frame latent) in the node pack's workflow.
## License
Weights inherit the upstream **LingBot-Video license** (see `license_link`). This repo is
a format repack only; review the upstream terms before commercial use or redistribution.
Repack + nodes by [RealRebelAI](https://huggingface.co/realrebelai).