Instructions to use nvidia/personaplex-7b-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Moshi
How to use nvidia/personaplex-7b-v1 with Moshi:
# pip install moshi # Run the interactive web server python -m moshi.server --hf-repo "nvidia/personaplex-7b-v1" # Then open https://localhost:8998 in your browser
# pip install moshi import torch from moshi.models import loaders # Load checkpoint info from HuggingFace checkpoint = loaders.CheckpointInfo.from_hf_repo("nvidia/personaplex-7b-v1") # Load the Mimi audio codec mimi = checkpoint.get_mimi(device="cuda") mimi.set_num_codebooks(8) # Encode audio (24kHz, mono) wav = torch.randn(1, 1, 24000 * 10) # [batch, channels, samples] with torch.no_grad(): codes = mimi.encode(wav.cuda()) decoded = mimi.decode(codes) - Inference
- Notebooks
- Google Colab
- Kaggle
[Feature Request] PersonaPlex-7B: Fine-Tuning, RAG & Custom Voice Support
Hi π Iβm using nvidia/personaplex-7b-v1 to build a real-time voice customer support agent and have a few questions:
- Fine-tuning
Are fine-tuning scripts/docs planned?
Supported data formats (audio + transcripts)?
Hardware requirements?
LoRA / QLoRA support?
- Custom knowledge integration
Max context/token limit for prompts?
Can context be updated dynamically during a session?
Recommended RAG setup (ASR β RAG β PersonaPlex)?
Latency considerations for real-time/full-duplex use?
Is domain fine-tuning supported/planned?
- Custom voice
Custom voice embeddings or voice cloning?
Required audio format and duration?
Current workaround: static prompt-based knowledge
Limitations: token limits, no retrieval, manual updates
Env: A10G 24GB | production voice agent
Thanks! Any guidance or roadmap info would be appreciated.
Hey I have been trying to use the model for some use-cases and want to know is there any official doc or soemthing regarding the fine-tuning of the model.
I don't recommend using this model checkpoint for production. Its more of a showcase for naturalness. Stay tuned for future models that are smarter and are packaged with finetuning flows and toolcalling support. Can't promise custom voice though since its extremely difficult to get legal approval for that.
Any updates on this topic?
bump
:-(