Instructions to use nvidia/personaplex-7b-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Moshi
How to use nvidia/personaplex-7b-v1 with Moshi:
# pip install moshi # Run the interactive web server python -m moshi.server --hf-repo "nvidia/personaplex-7b-v1" # Then open https://localhost:8998 in your browser
# pip install moshi import torch from moshi.models import loaders # Load checkpoint info from HuggingFace checkpoint = loaders.CheckpointInfo.from_hf_repo("nvidia/personaplex-7b-v1") # Load the Mimi audio codec mimi = checkpoint.get_mimi(device="cuda") mimi.set_num_codebooks(8) # Encode audio (24kHz, mono) wav = torch.randn(1, 1, 24000 * 10) # [batch, channels, samples] with torch.no_grad(): codes = mimi.encode(wav.cuda()) decoded = mimi.decode(codes) - Inference
- Notebooks
- Google Colab
- Kaggle
Getting KeyError: 'dep_q' while using moshi
#45
by Swarn - opened
Getting KeyError: 'dep_q' while running the server or in -mimi = checkpoint.get_mimi(device="cuda")
Is there some incompatibility between moshi and personaplex?
Yes there are incompatibilities. 1) Moshi does not support voice/text prompt section. 2) Moshi depformer has 8 channels of audio, while PersonaPlex has 16 due to historical trainings reasons which is no longer relevant but needs to be cleaned up. So PersonaPlex will likely not work with Moshi inference code, and Moshi will likely not work with PersonaPlex inference code.
royrajarshi changed discussion status to closed