John2J/SFVS / README.md
John2J's picture
|
download
raw
2.54 kB
---
license: mit
language: en
pipeline_tag: text-to-audio
base_model: hkchengrex/MMAudio
---
# Fine-tuned MMAudio Model
This repository contains a fine-tuned version of the **MMAudio** model, specializing in generating audio from video, image, and text prompts. The model was fine-tuned on a private dataset, resulting in the `cloud19/NSFW_MMaudio` checkpoint. Specializing in NSFW videos of various kinds.
**Original Project:** [hkchengrex/MMAudio](https://github.com/hkchengrex/MMAudio)
## Model Details
* **Base Architecture:** `large_44k` (from the original MMAudio)
* **Fine-tuning:** The model was fine-tuned on a private dataset of NSFW content to explore the model's adaptability to specific audio domains. Due to the nature of the training data, the generated audio may reflect mature themes.
* **Capabilities:** Video-to-Audio, Image-to-Audio, Text-to-Audio.
## How to Use
This repository includes a fully functional Gradio (`app.py`). To run it locally, follow these steps. GPU 12-16 GB preferred.
**Prerequisites:**
* Python 3.10+
* Git and Git LFS (`git-lfs` must be installed)
### Step-by-Step Instructions
1. **Clone the repository:**
Open your terminal and clone the repository. `git-lfs` will automatically handle downloading the large model file.
```bash
git clone https://huggingface.co/cloud19/NSFW_MMaudio
cd NSFW_MMaudio
```
2. **Set up a virtual environment (recommended):**
```bash
python -m venv venv
source venv/bin/activate
# On Windows, use: venv\Scripts\activate
```
3. **Install the required dependencies:**
The `requirements.txt` file contains all necessary packages.
```bash
pip install -r requirements.txt
```
4. **Run the Gradio application:**
This will launch a local web server.
```bash
python app.py
```
Now you can use the web interface to generate audio with your fine-tuned model.
**Limitations:**
* The model's output is heavily influenced by its training data.
* **Content Warning:** Due to the NSFW nature of the fine-tuning dataset, the model may generate explicit or mature audio content. User discretion is advised.
* Like all generative models, it may produce artifacts or unexpected results.
## Original Model Citation
All credit for the original architecture, code, and pre-trained models goes to the authors of MMAudio. Please refer to their repository for more details.
* **Original GitHub:** [https://github.com/hkchengrex/MMAudio](https://github.com/hkchengrex/MMAudio)

Xet Storage Details

Size:
2.54 kB
·
Xet hash:
1e9149e241972b470a4750aba5c18f3cc717f5aa18137b3e3404be1f6d45956c

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.