WeMM-Video-35B-A3B ยท GGUF Q4_K_M

Model Collection Technical Report GitHub Hugging Face Paper

Overview

This repository contains the GGUF Q4_K_M bundle of WeMM-Video-35B-A3B for the WeMM native runtime. WeMM-Video is a Chineseโ€“English bilingual family for joint audio-visual understanding and reasoning. It accepts text, images, audio, and video and generates text responses.

Files and Quantization

File Role Size
language.gguf Language model, tokenizer, and chat template 22.61 GiB
mmproj.gguf Vision encoder and projector 0.84 GiB
audio.gguf Audio encoder and projector 1.99 GiB

The Q4_K_M recipe protects selected attention and input/output tensors in BF16. See the precision scope and bundle manifest. Keep all three GGUF files at the same Hub revision.

Quick Start

Build the WeMM native runtime and install huggingface_hub. Run the examples from the WeMM-Video repository root to use the bundled media. The launcher fetches the three matching components from the Hub. A prompt by itself sends a text-only request. Use --video for frames alone and --video-audio for frames and the original soundtrack.

export PATH="$PWD/native/install-cpu/bin:$PATH"
MODEL=tencent/WeMM-Video-35BA3B-GGUF
MEDIA=examples/media

python native/run_hf.py --repo-id "$MODEL" \
  --prompt "A 20-minute meeting starts at 09:45. When does it end?" --output text-result.json
python native/run_hf.py --repo-id "$MODEL" --image "$MEDIA/apollo-11-earth.jpg" \
  --prompt "Describe the planet in this image." --output image-result.json
python native/run_hf.py --repo-id "$MODEL" --audio "$MEDIA/apollo-11-small-step.wav" \
  --prompt "Transcribe the English speech in this recording." --output audio-result.json
python native/run_hf.py --repo-id "$MODEL" --video "$MEDIA/apollo-11-first-steps.mp4" \
  --max-frames 16 --prompt "Describe what happens on screen." --output video-result.json
python native/run_hf.py --repo-id "$MODEL" --video-audio "$MEDIA/apollo-11-first-steps.mp4" \
  --max-frames 16 --prompt "Describe the scene and summarize the speech." --output video-audio-result.json

Choose new --output filenames when rerunning the examples. Use --revision to pin the bundle. See the native guide for CUDA offload.

Validation

The WeMM native CPU runtime loaded the bundle and completed generation checks for text, image, audio, and video with a soundtrack.

Evaluation

See the WeMM-Video-35B-A3B evaluation results for the benchmark comparison in the technical report.

License

Apache License 2.0. See the included license and the collection license and third-party attribution. Third-party components remain subject to their original terms.

Citation

@misc{WeMM-Video,
      title={WeMM-Video: Pushing the Frontiers of Open-Source Omni-Modal Video Understanding}, 
      author={Changli Tang and Jie Yang and Tianyi Wang and Lei Li and Daoze Zhang and Zijie Xin and Zhan Liu and Li Li and Jinchang Xu and Fengyun Rao and Chao Zhang and Jing Lyu},
      year={2026},
      eprint={2611.26409},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2611.26409}, 
}
Downloads last month
5
GGUF
Model size
1B params
Architecture
wemm_audio
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for tencent/WeMM-Video-35BA3B-GGUF

Quantized
(4)
this model

Collection including tencent/WeMM-Video-35BA3B-GGUF

Paper for tencent/WeMM-Video-35BA3B-GGUF