Instructions to use vanbach1994hn/HH3D with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use vanbach1994hn/HH3D with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("pnnbao-ump/VieNeu-TTS-0.3B")
model = PeftModel.from_pretrained(base_model, "vanbach1994hn/HH3D")

Transformers

How to use vanbach1994hn/HH3D with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="vanbach1994hn/HH3D")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("vanbach1994hn/HH3D", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use vanbach1994hn/HH3D with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "vanbach1994hn/HH3D"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanbach1994hn/HH3D",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/vanbach1994hn/HH3D

SGLang

How to use vanbach1994hn/HH3D with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "vanbach1994hn/HH3D" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanbach1994hn/HH3D",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "vanbach1994hn/HH3D" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanbach1994hn/HH3D",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use vanbach1994hn/HH3D with Docker Model Runner:
```
docker model run hf.co/vanbach1994hn/HH3D
```

vanbach1994hn commited on Jun 19

Commit

0e67d00

verified ·

1 Parent(s): 2864f69

Delete voices.json

Browse files

Files changed (1) hide show

voices.json +0 -406

voices.json DELETED Viewed

@@ -1,406 +0,0 @@
-{
-  "meta": {
-    "spec": "vieneu.voice.presets",
-    "spec_version": "1.0",
-    "engine": "VieNeu-TTS",
-    "author": "Phạm Nguyễn Ngọc Bảo (pnnbao-ump)",
-    "license": "CC BY-NC 4.0",
-    "homepage": "https://github.com/pnnbao97/VieNeu-TTS",
-    "notice": "Model and voices are for non-commercial use only. Mention pnnbao-ump when using."
-  },
-  "default_voice": "HH3D",
-  "presets": {
-    "HH3D": {
-      "codes": [
-        2154,
-        2294,
-        2298,
-        2218,
-        2218,
-        2218,
-        2222,
-        2222,
-        2218,
-        1258,
-        2238,
-        1142,
-        3302,
-        36313,
-        59805,
-        55708,
-        30732,
-        40218,
-        27500,
-        23340,
-        31613,
-        15266,
-        12523,
-        15077,
-        57315,
-        17290,
-        19364,
-        2201,
-        11440,
-        60570,
-        57358,
-        55818,
-        52530,
-        36889,
-        12163,
-        12561,
-        45736,
-        54041,
-        21340,
-        6044,
-        36338,
-        36065,
-        19945,
-        52442,
-        36755,
-        18312,
-        1825,
-        16474,
-        42532,
-        37305,
-        182,
-        27155,
-        23591,
-        6481,
-        19505,
-        37924,
-        39747,
-        17285,
-        19249,
-        1435,
-        15408,
-        14811,
-        36208,
-        52722,
-        56794,
-        62937,
-        17612,
-        3315,
-        19639,
-        19690,
-        18667,
-        18667,
-        18667,
-        3310,
-        2282,
-        2282,
-        2282,
-        2282,
-        2282,
-        2282,
-        2282,
-        2282,
-        3562,
-        3306,
-        3306,
-        3306,
-        3306,
-        3306,
-        3306,
-        2282,
-        2282,
-        2282,
-        2554,
-        1126,
-        2278,
-        3251,
-        57043,
-        36849,
-        9159,
-        9109,
-        1864,
-        18724,
-        41354,
-        33060,
-        952,
-        36375,
-        3106,
-        39972,
-        54324,
-        13760,
-        14875,
-        15509,
-        12088,
-        24564,
-        56734,
-        55885,
-        53401,
-        59683,
-        8954,
-        13947,
-        9782,
-        1909,
-        1957,
-        22283,
-        56135,
-        57253,
-        19295,
-        3437,
-        9310,
-        44457,
-        35438,
-        9369,
-        15445,
-        44835,
-        36147,
-        18481,
-        35586,
-        54564,
-        10697,
-        6177,
-        8338,
-        12457,
-        4786,
-        36595,
-        33195,
-        41853,
-        35447,
-        50110,
-        1898,
-        35570,
-        53235,
-        658,
-        1561,
-        50958,
-        35468,
-        17994,
-        5732,
-        36147,
-        55590,
-        6442,
-        4136,
-        39906,
-        34585,
-        23112,
-        17998,
-        25930,
-        17544,
-        34393,
-        41186,
-        4002,
-        12679,
-        46952,
-        27580,
-        20469,
-        50341,
-        60659,
-        6870,
-        27555,
-        970,
-        34574,
-        42125,
-        9243,
-        12401,
-        33337,
-        4798,
-        15270,
-        36327,
-        31467,
-        35827,
-        3562,
-        14900,
-        15769,
-        17953,
-        657,
-        16629,
-        38690,
-        36251,
-        59915,
-        44758,
-        16298,
-        19358,
-        19550,
-        3141,
-        46873,
-        13045,
-        46866,
-        59435,
-        6177,
-        20001,
-        34836,
-        51459,
-        38816,
-        50902,
-        20144,
-        24139,
-        50207,
-        59670,
-        53276,
-        36835,
-        3952,
-        34810,
-        19760,
-        10930,
-        11249,
-        43376,
-        61666,
-        3222,
-        3323,
-        3323,
-        18666,
-        3311,
-        18671,
-        19695,
-        18603,
-        19694,
-        3311,
-        19690,
-        19690,
-        19690,
-        19690,
-        19690,
-        19690,
-        19690,
-        19690,
-        19690,
-        3306,
-        3306,
-        3306,
-        3306,
-        3306,
-        3306,
-        18666,
-        3306,
-        2278,
-        2298,
-        2474,
-        2086,
-        3302,
-        36311,
-        7260,
-        16362,
-        13373,
-        15036,
-        14185,
-        28442,
-        49195,
-        53274,
-        60950,
-        32748,
-        13199,
-        15244,
-        17935,
-        25761,
-        8229,
-        23446,
-        32483,
-        19175,
-        36855,
-        10699,
-        8626,
-        8378,
-        12339,
-        31991,
-        35751,
-        21098,
-        30247,
-        17826,
-        2657,
-        136,
-        13838,
-        9741,
-        38232,
-        46452,
-        313,
-        1462,
-        55971,
-        50199,
-        50883,
-        50968,
-        1433,
-        50964,
-        33721,
-        1653,
-        16822,
-        28419,
-        39987,
-        33840,
-        33617,
-        18181,
-        54664,
-        34126,
-        25673,
-        6814,
-        23786,
-        40807,
-        52709,
-        34730,
-        11421,
-        4623,
-        30797,
-        41165,
-        45461,
-        19281,
-        17063,
-        15027,
-        8582,
-        18016,
-        15752,
-        10865,
-        3657,
-        23089,
-        19586,
-        38647,
-        35798,
-        40723,
-        36659,
-        18488,
-        39811,
-        3956,
-        35310,
-        3169,
-        13665,
-        7129,
-        44375,
-        54543,
-        59789,
-        44040,
-        40906,
-        52012,
-        2333,
-        36524,
-        23416,
-        19121,
-        1259,
-        10919,
-        55523,
-        50602,
-        47334,
-        1162,
-        3319,
-        19627,
-        19691,
-        18603,
-        18603,
-        19694,
-        19694,
-        19690,
-        19690,
-        19690,
-        19690,
-        19690,
-        19690,
-        19606,
-        19622,
-        19622,
-        19622,
-        19622,
-        19622,
-        19686,
-        19690,
-        19690,
-        19686,
-        19686,
-        19670,
-        19674,
-        2265
-      ],
-      "text": "Không được phép gây sự Đợi sau khi họ rời đi Na Tra lúc này mới hỏi Sư phụ Có phải mình lại gây ra họa lớn rồi không.",
-      "description": "Giọng nữ, review phim"
-    }
-  }
-}