tortoise-base / src /train.py

Commit History

DLAS is PIPified (but I'm still cloning it as a submodule to make updating it easier)
0c2a916

mrq commited on

fixes #134
84b7383

mrq commited on

;)
7b16b3e

mrq commited on

simplified spawning the training process by having it spawn the distributed training processes in the train.py script, so it should work on Windows too
008a1f5

ecker commited on

rewrote how AIVC gets training metrics (need to clean up later)
7f2da0f

ecker commited on

while I'm breaking things, migrating dependencies to modules folder for tidiness
b64948d

ecker commited on

big cleanup to make my life easier when i add more parameters
3f321fe

ecker commited on

actually make using adamw_zero optimizer for multi-gpus work
34dcb84

ecker commited on

I forgot about the changelog and never kept up with it, so I'll just not use a changelog
d7e75a5

ecker commited on

use torchrun instead for multigpu
37cab14

ecker commited on

experimental multi-gpu training (Linux only, because I can't into batch files)
e859a7c

ecker commited on

Added option to disable bitsandbytesoptimizations for systems that do not support it (systems without a Turing-onward Nvidia card), saves use of float16 and bitsandbytes for training into the config json
9255397

ecker commited on

fixed some files not copying for bitsandbytes (I was wrong to assume it copied folders too), fixed stopping generating and training, some other thing that I forgot since it's been slowly worked on in my small free times
d5d8821

ecker commited on

ugh
41fca1a

ecker commited on

removed the logic to toggle BNB capabilities, since I guess I can't do that from outside the module
941a27d

ecker commited on

huge success
225dee2

ecker commited on

handled paths that contain spaces because python for whatever god forsaken reason will always split on spaces even if wrapping an argument in quotes
bacac6d

ecker commited on

a bit of UI cleanup, import multiple audio files at once, actually shows progress when importing voices, hides audio metadata / latents if no generated settings are detected, preparing datasets shows its progress, saving a training YAML shows a message when done, training now works within the web UI, training output shows to web UI, provided notebook is cleaned up and uses a venv, etc.
d5c1433

ecker commited on

cleanup, "injected" dvae.pth to download through tortoise's model loader, so I don't need to keep copying it
bcec64a

ecker commited on

training added, seems to work, need to test it more
8d268bc

ecker commited on

updated notebooks to use the new "main" setup
9c0e466

ecker commited on

tab to generate the training YAML
f8249aa

ecker commited on