| | --- |
| | license: other |
| | license_name: sam-license |
| | license_link: LICENSE |
| | tags: |
| | - audio |
| | - audio-separation |
| | - sound-separation |
| | - sam-audio |
| | - meta |
| | - pytorch |
| | - safetensors |
| | - bf16 |
| | pipeline_tag: audio-to-audio |
| | base_model: facebook/sam-audio-large-tv |
| | --- |
| | |
| | # SAM-Audio Models (BF16 Safetensors) |
| |
|
| | **Ungated mirrors** of Meta's [SAM-Audio](https://github.com/facebookresearch/sam-audio) model weights, converted to BF16 safetensors format and redistributed under the [SAM License](LICENSE) for easier access. |
| |
|
| | ## What is SAM-Audio? |
| |
|
| | SAM-Audio (Segment Anything Model for Audio) is Meta AI's foundation model for **isolating any sound in audio** using text, visual, or temporal prompts. It can separate specific sounds from complex audio mixtures. |
| |
|
| | - **Text prompts** — isolate sounds by describing them (e.g. *"drums"*, *"vocals"*, *"piano"*) |
| | - **Visual prompts** — point at objects in video to extract their sound |
| | - **Span prompts** — specify time ranges where the target sound occurs |
| |
|
| | The `-tv` variants are optimized for **target correctness** and **visual prompting**. |
| |
|
| | ## Available Models |
| |
|
| | | Model | Parameters | File Size | Original | |
| | |---|---|---|---| |
| | | `sam-audio-large-tv-bf16.safetensors` | 3,715,221,638 | 6.92 GiB | [facebook/sam-audio-large-tv](https://huggingface.co/facebook/sam-audio-large-tv) | |
| | | `sam-audio-base-tv-bf16.safetensors` | 1,931,243,654 | 3.60 GiB | [facebook/sam-audio-base-tv](https://huggingface.co/facebook/sam-audio-base-tv) | |
| |
|
| | ## Files |
| |
|
| | | File | Description | |
| | |---|---| |
| | | `sam-audio-large-tv-bf16.safetensors` | Large-TV model weights (BF16) | |
| | | `sam-audio-base-tv-bf16.safetensors` | Base-TV model weights (BF16) | |
| | | `config.json` | Model configuration | |
| | | `LICENSE` | SAM License (required for redistribution) | |
| |
|
| | ## Usage |
| |
|
| | ```python |
| | # With ComfyUI-FFMPEGA (automatic download) |
| | # Set no_llm_mode = "audio_separate" and prompt = "vocals" |
| | |
| | # Or standalone: |
| | from sam_audio import SAMAudio |
| | model = SAMAudio.from_pretrained("path/to/this/repo") |
| | ``` |
| |
|
| | ## License |
| |
|
| | This model is distributed under the **SAM License** — see the [LICENSE](LICENSE) file. Key points: |
| |
|
| | - ✅ Commercial use permitted |
| | - ✅ Redistribution permitted (with license included) |
| | - ✅ Derivative works permitted |
| | - ❌ No military/warfare, nuclear, or espionage use |
| | - ❌ No reverse engineering |
| |
|
| | ## Credits |
| |
|
| | - **Original model by**: [Meta AI (FAIR)](https://github.com/facebookresearch/sam-audio) |
| | - **Paper**: *SAM-Audio: Segment Anything in Audio* |
| | - **Redistributed by**: [Æmotion Studio](https://huggingface.co/AEmotionStudio) for use with [ComfyUI-FFMPEGA](https://github.com/AEmotionStudio/ComfyUI-FFMPEGA) |
| |
|
