Spaces:
Runtime error
Runtime error
Hugo Flores Garcia
commited on
Commit
Β·
6fcf6a4
1
Parent(s):
e3ca5f7
update readme
Browse files
README.md
CHANGED
|
@@ -31,17 +31,59 @@ pip install -e ./vampnet2
|
|
| 31 |
This repository relies on [argbind](https://github.com/pseeth/argbind) to manage CLIs and config files.
|
| 32 |
Config files are stored in the `conf/` folder.
|
| 33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
# How the code is structured
|
| 35 |
|
| 36 |
This code was written fast to meet a publication deadline, so it can be messy and redundant at times. Currently working on cleaning it up.
|
| 37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
# Usage
|
| 39 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
## Staging a Run
|
| 41 |
|
| 42 |
Staging a run makes a copy of all the git-tracked files in the codebase and saves them to a folder for reproducibility. You can then run the training script from the staged folder.
|
| 43 |
|
| 44 |
-
|
|
|
|
|
|
|
| 45 |
|
| 46 |
## Training a model
|
| 47 |
|
|
@@ -56,8 +98,6 @@ You just need to provide a list of audio files // folders to fine-tune on, then
|
|
| 56 |
python scripts/exp/train.py --args.load conf/lora/birds.yml --save_path /path/to/checkpoints
|
| 57 |
```
|
| 58 |
|
| 59 |
-
## Getting the Pretrained Models
|
| 60 |
-
|
| 61 |
|
| 62 |
|
| 63 |
## Launching the Gradio Interface
|
|
|
|
| 31 |
This repository relies on [argbind](https://github.com/pseeth/argbind) to manage CLIs and config files.
|
| 32 |
Config files are stored in the `conf/` folder.
|
| 33 |
|
| 34 |
+
## Getting the Pretrained Models
|
| 35 |
+
|
| 36 |
+
Download the pretrained models from [this link](). Then, extract the models to the `models/` folder.
|
| 37 |
+
|
| 38 |
# How the code is structured
|
| 39 |
|
| 40 |
This code was written fast to meet a publication deadline, so it can be messy and redundant at times. Currently working on cleaning it up.
|
| 41 |
|
| 42 |
+
```
|
| 43 |
+
βββ conf <- (conf files for training, finetuning, etc)
|
| 44 |
+
βββ demo.py <- (gradio UI for playing with vampnet)
|
| 45 |
+
βββ env <- (environment variables)
|
| 46 |
+
βΒ Β βββ env.sh
|
| 47 |
+
βββ models <- (extract pretrained models)
|
| 48 |
+
βΒ Β βββ spotdl
|
| 49 |
+
βΒ Β βΒ Β βββ c2f.pth <- (coarse2fine checkpoint)
|
| 50 |
+
βΒ Β βΒ Β βββ coarse.pth <- (coarse checkpoint)
|
| 51 |
+
βΒ Β βΒ Β βββ codec.pth <- (codec checkpoint)
|
| 52 |
+
βΒ Β βββ wavebeat.pth
|
| 53 |
+
βββ README.md
|
| 54 |
+
βββ scripts
|
| 55 |
+
βΒ Β βββ exp
|
| 56 |
+
βΒ Β βΒ Β βββ eval.py <- (eval script)
|
| 57 |
+
βΒ Β βΒ Β βββ train.py <- (training/finetuning script)
|
| 58 |
+
βΒ Β βββ utils
|
| 59 |
+
βββ vampnet
|
| 60 |
+
βΒ Β βββ beats.py <- (beat tracking logic)
|
| 61 |
+
βΒ Β βββ __init__.py
|
| 62 |
+
βΒ Β βββ interface.py <- (high-level programmatic interface)
|
| 63 |
+
βΒ Β βββ mask.py
|
| 64 |
+
βΒ Β βββ modules
|
| 65 |
+
βΒ Β βΒ Β βββ activations.py
|
| 66 |
+
βΒ Β βΒ Β βββ __init__.py
|
| 67 |
+
βΒ Β βΒ Β βββ layers.py
|
| 68 |
+
βΒ Β βΒ Β βββ transformer.py <- (architecture + sampling code)
|
| 69 |
+
βΒ Β βββ scheduler.py
|
| 70 |
+
βΒ Β βββ util.py
|
| 71 |
+
```
|
| 72 |
+
|
| 73 |
# Usage
|
| 74 |
|
| 75 |
+
First, you'll want to set up your environment
|
| 76 |
+
```bash
|
| 77 |
+
source ./env/env.sh
|
| 78 |
+
```
|
| 79 |
+
|
| 80 |
## Staging a Run
|
| 81 |
|
| 82 |
Staging a run makes a copy of all the git-tracked files in the codebase and saves them to a folder for reproducibility. You can then run the training script from the staged folder.
|
| 83 |
|
| 84 |
+
```
|
| 85 |
+
stage --name my_run --run_dir /path/to/staging/folder
|
| 86 |
+
```
|
| 87 |
|
| 88 |
## Training a model
|
| 89 |
|
|
|
|
| 98 |
python scripts/exp/train.py --args.load conf/lora/birds.yml --save_path /path/to/checkpoints
|
| 99 |
```
|
| 100 |
|
|
|
|
|
|
|
| 101 |
|
| 102 |
|
| 103 |
## Launching the Gradio Interface
|