--- license: other license_name: sam-license license_link: LICENSE tags: - audio - audio-separation - sound-separation - sam-audio - meta - pytorch - safetensors - bf16 pipeline_tag: audio-to-audio base_model: facebook/sam-audio-large-tv --- # SAM-Audio Models (BF16 Safetensors) **Ungated mirrors** of Meta's [SAM-Audio](https://github.com/facebookresearch/sam-audio) model weights, converted to BF16 safetensors format and redistributed under the [SAM License](LICENSE) for easier access. ## What is SAM-Audio? SAM-Audio (Segment Anything Model for Audio) is Meta AI's foundation model for **isolating any sound in audio** using text, visual, or temporal prompts. It can separate specific sounds from complex audio mixtures. - **Text prompts** — isolate sounds by describing them (e.g. *"drums"*, *"vocals"*, *"piano"*) - **Visual prompts** — point at objects in video to extract their sound - **Span prompts** — specify time ranges where the target sound occurs The `-tv` variants are optimized for **target correctness** and **visual prompting**. ## Available Models | Model | Parameters | File Size | Original | |---|---|---|---| | `sam-audio-large-tv-bf16.safetensors` | 3,715,221,638 | 6.92 GiB | [facebook/sam-audio-large-tv](https://huggingface.co/facebook/sam-audio-large-tv) | | `sam-audio-base-tv-bf16.safetensors` | 1,931,243,654 | 3.60 GiB | [facebook/sam-audio-base-tv](https://huggingface.co/facebook/sam-audio-base-tv) | ## Files | File | Description | |---|---| | `sam-audio-large-tv-bf16.safetensors` | Large-TV model weights (BF16) | | `sam-audio-base-tv-bf16.safetensors` | Base-TV model weights (BF16) | | `config.json` | Model configuration | | `LICENSE` | SAM License (required for redistribution) | ## Usage ```python # With ComfyUI-FFMPEGA (automatic download) # Set no_llm_mode = "audio_separate" and prompt = "vocals" # Or standalone: from sam_audio import SAMAudio model = SAMAudio.from_pretrained("path/to/this/repo") ``` ## License This model is distributed under the **SAM License** — see the [LICENSE](LICENSE) file. Key points: - ✅ Commercial use permitted - ✅ Redistribution permitted (with license included) - ✅ Derivative works permitted - ❌ No military/warfare, nuclear, or espionage use - ❌ No reverse engineering ## Credits - **Original model by**: [Meta AI (FAIR)](https://github.com/facebookresearch/sam-audio) - **Paper**: *SAM-Audio: Segment Anything in Audio* - **Redistributed by**: [Æmotion Studio](https://huggingface.co/AEmotionStudio) for use with [ComfyUI-FFMPEGA](https://github.com/AEmotionStudio/ComfyUI-FFMPEGA)