Instructions to use realrebelai/LingBot_ComfyUI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use realrebelai/LingBot_ComfyUI with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("realrebelai/LingBot_ComfyUI", torch_dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
File size: 3,215 Bytes
5211460 3e21d12 65ede0d 3e21d12 fba6c0c 3e21d12 979eee3 5211460 51cd0b8 3e21d12 51cd0b8 8cb018f 7eedcff 32bd636 3e21d12 51cd0b8 3e21d12 0711f7c 3e21d12 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 | ---
license: other
license_name: lingbot-video-license
license_link: https://huggingface.co/robbyant/lingbot-video-dense-1.3b
base_model: robbyant/lingbot-video-dense-1.3b
library_name: diffusers
tags:
- f16
- video
- text-to-video
- image-to-video
- comfyui
- wan-vae
- qwen3-vl
- low-vram
- quantization
---
# LingBot-Video-Dense-1.3B — ComfyUI repack (single-file, 8GB-VRAM ready)
<div align="center">
<video
src="https://cdn-uploads.huggingface.co/production/uploads/68761990332d15464ccc8dee/4c5xvrkNvb1Nde1xUK1Eu.mp4"
width="400"
height="400"
autoplay
loop
muted
playsinline
></video>
</div>
<div align="center">
<video
src="https://cdn-uploads.huggingface.co/production/uploads/68761990332d15464ccc8dee/yNFPaS5D-dPPVMJdqiTTb.mp4"
width="400"
height="400"
autoplay
loop
muted
playsinline
></video>
</div>
## UPDATE! - added a prompt rebuilder node to satisfy the models need for a VERY strict json structure. this is not normal json, its what i like to call "LingBot" json prompting as its alot more in depth. try it out!
Repackaged weights of [robbyant/lingbot-video-dense-1.3b](https://huggingface.co/robbyant/lingbot-video-dense-1.3b)
for use with the **[ComfyUI_Rebels_LingBot](https://github.com/RealRebelAI/ComfyUI_Rebels_LingBot)**
node pack. No weight modification — the original diffusers shards are merged/renamed into
single files for ComfyUI's model folders. All configs ship inside the node pack.
Runs T2V and TI2V on an **RTX 3070 8GB / 16GB RAM**: the Qwen3-VL encoder is loaded on
CPU, used, and freed before the 1.3B DiT (2.79GB bf16, fully VRAM-resident) starts.
## Files
| File | Put in | Size |
|---|---|---|
| `LingBot_1.3b_DiT.safetensors` | `ComfyUI/models/diffusion_models/` | ~2.8 GB |
| `LingBot_text-encoder.safetensors` | `ComfyUI/models/text_encoders/` | ~8 GB |
| `LingBot_vae.safetensors` | `ComfyUI/models/vae/` | ~0.5 GB |
The text encoder is the repo's Qwen3-VL, shards merged into one file (bit-identical
tensors). `lm_head.weight` is intentionally absent — it is tied to `embed_tokens`; the
node pack re-ties it at load.
## Recommended settings
- **832×480**, up to **81 frames**, 40 steps, shift 3.0
- guidance **3.0** (t2v) / **~3.0** (TI2V — higher burns color on image runs)
- export at **24 fps**
- VAE tiling **off** unless you must (temporal color/exposure drift on long clips)
~14 s/it on a 3070 at the settings above (sequential CFG); ≈10 minutes per 81-frame clip.
## Notes & limitations
- The trained window is 81 frames; longer generations collapse.
- Square/other aspect ratios are out-of-distribution (letterboxing artifacts) — stay at 832×480.
- 1.3B-class video: modest motion complexity; rendered text (signs/labels) is not legible.
- TI2V requires the image to be fed to **both** the encode node (vision conditioning) and
the sampler (first-frame latent) in the node pack's workflow.
## License
Weights inherit the upstream **LingBot-Video license** (see `license_link`). This repo is
a format repack only; review the upstream terms before commercial use or redistribution.
Repack + nodes by [RealRebelAI](https://huggingface.co/realrebelai).
|