Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

prithivMLmods
/
VoxCPM2-GGUF

Text-to-Speech
VoxCPM
GGUF
llama-cpp
llama-tts
tts
VoxCPM2
multilingual
voice-cloning
voice-design
diffusion
audio
2B
conversational
Model card Files Files and versions
xet
Community

Instructions to use prithivMLmods/VoxCPM2-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • VoxCPM

    How to use prithivMLmods/VoxCPM2-GGUF with VoxCPM:

    import soundfile as sf
    from voxcpm import VoxCPM
    
    model = VoxCPM.from_pretrained("prithivMLmods/VoxCPM2-GGUF")
    
    wav = model.generate(
        text="VoxCPM is an innovative end-to-end TTS model from ModelBest, designed to generate highly expressive speech.",
        prompt_wav_path=None,      # optional: path to a prompt speech for voice cloning
        prompt_text=None,          # optional: reference text
        cfg_value=2.0,             # LM guidance on LocDiT, higher for better adherence to the prompt, but maybe worse
        inference_timesteps=10,   # LocDiT inference timesteps, higher for better result, lower for fast speed
        normalize=True,           # enable external TN tool
        denoise=True,             # enable external Denoise tool
        retry_badcase=True,        # enable retrying mode for some bad cases (unstoppable)
        retry_badcase_max_times=3,  # maximum retrying times
        retry_badcase_ratio_threshold=6.0, # maximum length restriction for bad case detection (simple but effective), it could be adjusted for slow pace speech
    )
    
    sf.write("output.wav", wav, 16000)
    print("saved: output.wav")
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • llama.cpp

    How to use prithivMLmods/VoxCPM2-GGUF with llama.cpp:

    Install (macOS, Linux)
    curl -LsSf https://llama.app/install.sh | sh
    # Start a local OpenAI-compatible server with a web UI:
    llama serve -hf prithivMLmods/VoxCPM2-GGUF:Q4_K_M
    # Run inference directly in the terminal:
    llama cli -hf prithivMLmods/VoxCPM2-GGUF:Q4_K_M
    Install from WinGet (Windows)
    winget install llama.cpp
    # Start a local OpenAI-compatible server with a web UI:
    llama serve -hf prithivMLmods/VoxCPM2-GGUF:Q4_K_M
    # Run inference directly in the terminal:
    llama cli -hf prithivMLmods/VoxCPM2-GGUF:Q4_K_M
    Build from source code
    git clone https://github.com/ggml-org/llama.cpp.git
    cd llama.cpp
    cmake -B build
    cmake --build build -j --target llama-app
    # Start a local OpenAI-compatible server with a web UI:
    ./build/bin/llama serve -hf prithivMLmods/VoxCPM2-GGUF:Q4_K_M
    # Run inference directly in the terminal:
    ./build/bin/llama cli -hf prithivMLmods/VoxCPM2-GGUF:Q4_K_M
    Use Docker
    docker model run hf.co/prithivMLmods/VoxCPM2-GGUF:Q4_K_M
  • Llama new
  • LM Studio
  • Jan
  • Ollama

    How to use prithivMLmods/VoxCPM2-GGUF with Ollama:

    ollama run hf.co/prithivMLmods/VoxCPM2-GGUF:Q4_K_M
  • Unsloth Desktop
  • Docker Model Runner

    How to use prithivMLmods/VoxCPM2-GGUF with Docker Model Runner:

    docker model run hf.co/prithivMLmods/VoxCPM2-GGUF:Q4_K_M
  • Lemonade

    How to use prithivMLmods/VoxCPM2-GGUF with Lemonade:

    Pull the model
    # Download Lemonade from https://lemonade-server.ai/
    lemonade pull prithivMLmods/VoxCPM2-GGUF:Q4_K_M
    Run and chat with the model
    lemonade run user.VoxCPM2-GGUF-Q4_K_M
    List all available models
    lemonade list
  • Atomic Chat
VoxCPM2-GGUF
13.2 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
prithivMLmods's picture
prithivMLmods
Update README.md
4cd718a verified about 17 hours ago
  • .gitattributes
    2.08 kB
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • README.md
    5.15 kB
    Update README.md about 17 hours ago
  • VoxCPM2.BF16.gguf
    2.95 GB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.Q3_K_L.gguf
    818 MB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.Q3_K_M.gguf
    759 MB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.Q4_K_M.gguf
    916 MB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.Q4_K_S.gguf
    874 MB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.Q5_K_M.gguf
    1.06 GB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.Q5_K_S.gguf
    1.03 GB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.Q6_K.gguf
    1.21 GB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.Q8_0.gguf
    1.57 GB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago
  • VoxCPM2.mmproj-bf16.gguf
    2.01 GB
    xet
    Upload GGUF quants β€” openbmb/VoxCPM2 about 18 hours ago