modus-16mod-stage3 / README.md
mqye's picture
Add files using upload-large-folder tool
8a09ab3 verified
|
Raw
History Blame Contribute Delete
1.34 kB
---
license: other
license_name: bagel-derived
license_link: https://huggingface.co/ByteDance-Seed/BAGEL-7B-MoT
gated: manual
extra_gated_heading: "Access MODUS 16-modality weights"
extra_gated_prompt: >-
These weights are derived from ByteDance BAGEL-7B-MoT and fine-tuned on the
MODUS 16-modality dataset. By requesting access you agree to use them for
research purposes only, consistent with the upstream BAGEL license.
extra_gated_fields:
Name: text
Affiliation: text
I will use these weights for research purposes only: checkbox
extra_gated_button_content: "Request access"
tags:
- multimodal
- any-to-any
- modus
library_name: safetensors
---
# MODUS β€” 16-modality stage-3 (noinstr)
Fine-tuned BAGEL-7B-MoT for the MODUS any-to-any demo (16 aligned modalities).
**Inference config (important):**
- modality config: `conf/modalities/instruction_16mod_stage2.yaml`
- `use_instruction=false` β€” run fully instruction-free (this checkpoint was
trained without target/condition/system instructions).
- weights are **bf16** (matching BAGEL's own release precision).
## Files
- `model.safetensors` β€” trained weights (bf16)
- `ae.safetensors` β€” VAE (image decode)
- `config.json` / `llm_config.json` / `vit_config.json` β€” architecture config
- `vocab.json` / `merges.txt` / `tokenizer_config.json` β€” tokenizer