Instructions to use vanbach1994hn/HH3D with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use vanbach1994hn/HH3D with PEFT:

from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("pnnbao-ump/VieNeu-TTS-0.3B")
model = PeftModel.from_pretrained(base_model, "vanbach1994hn/HH3D")

Transformers

How to use vanbach1994hn/HH3D with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="vanbach1994hn/HH3D")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("vanbach1994hn/HH3D", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use vanbach1994hn/HH3D with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "vanbach1994hn/HH3D"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanbach1994hn/HH3D",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/vanbach1994hn/HH3D

SGLang

How to use vanbach1994hn/HH3D with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "vanbach1994hn/HH3D" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanbach1994hn/HH3D",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "vanbach1994hn/HH3D" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "vanbach1994hn/HH3D",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use vanbach1994hn/HH3D with Docker Model Runner:
```
docker model run hf.co/vanbach1994hn/HH3D
```

vanbach1994hn commited on Jun 19

Commit

58b2bdc

verified ·

1 Parent(s): 0e67d00

Upload voices.json

Browse files

Files changed (1) hide show

voices.json +406 -0

voices.json ADDED Viewed

	@@ -0,0 +1,406 @@

+{
+  "meta": {
+    "spec": "vieneu.voice.presets",
+    "spec_version": "1.0",
+    "engine": "VieNeu-TTS",
+    "author": "Phạm Nguyễn Ngọc Bảo (pnnbao-ump)",
+    "license": "CC BY-NC 4.0",
+    "homepage": "https://github.com/pnnbao97/VieNeu-TTS",
+    "notice": "Model and voices are for non-commercial use only. Mention pnnbao-ump when using."
+  },
+  "default_voice": "my_voice",
+  "presets": {
+    "my_voice": {
+      "codes": [
+        2154,
+        2294,
+        2298,
+        2218,
+        2218,
+        2218,
+        2222,
+        2222,
+        2218,
+        1258,
+        2238,
+        1142,
+        3302,
+        36313,
+        59805,
+        55708,
+        30732,
+        40218,
+        27500,
+        23340,
+        31613,
+        15266,
+        12523,
+        15077,
+        57315,
+        17290,
+        19364,
+        2201,
+        11440,
+        60570,
+        57358,
+        55818,
+        52530,
+        36889,
+        12163,
+        12561,
+        45736,
+        54041,
+        21340,
+        6044,
+        36338,
+        36065,
+        19945,
+        52442,
+        36755,
+        18312,
+        1825,
+        16474,
+        42532,
+        37305,
+        182,
+        27155,
+        23591,
+        6481,
+        19505,
+        37924,
+        39747,
+        17285,
+        19249,
+        1435,
+        15408,
+        14811,
+        36208,
+        52722,
+        56794,
+        62937,
+        17612,
+        3315,
+        19639,
+        19690,
+        18667,
+        18667,
+        18667,
+        3310,
+        2282,
+        2282,
+        2282,
+        2282,
+        2282,
+        2282,
+        2282,
+        2282,
+        3562,
+        3306,
+        3306,
+        3306,
+        3306,
+        3306,
+        3306,
+        2282,
+        2282,
+        2282,
+        2554,
+        1126,
+        2278,
+        3251,
+        57043,
+        36849,
+        9159,
+        9109,
+        1864,
+        18724,
+        41354,
+        33060,
+        952,
+        36375,
+        3106,
+        39972,
+        54324,
+        13760,
+        14875,
+        15509,
+        12088,
+        24564,
+        56734,
+        55885,
+        53401,
+        59683,
+        8954,
+        13947,
+        9782,
+        1909,
+        1957,
+        22283,
+        56135,
+        57253,
+        19295,
+        3437,
+        9310,
+        44457,
+        35438,
+        9369,
+        15445,
+        44835,
+        36147,
+        18481,
+        35586,
+        54564,
+        10697,
+        6177,
+        8338,
+        12457,
+        4786,
+        36595,
+        33195,
+        41853,
+        35447,
+        50110,
+        1898,
+        35570,
+        53235,
+        658,
+        1561,
+        50958,
+        35468,
+        17994,
+        5732,
+        36147,
+        55590,
+        6442,
+        4136,
+        39906,
+        34585,
+        23112,
+        17998,
+        25930,
+        17544,
+        34393,
+        41186,
+        4002,
+        12679,
+        46952,
+        27580,
+        20469,
+        50341,
+        60659,
+        6870,
+        27555,
+        970,
+        34574,
+        42125,
+        9243,
+        12401,
+        33337,
+        4798,
+        15270,
+        36327,
+        31467,
+        35827,
+        3562,
+        14900,
+        15769,
+        17953,
+        657,
+        16629,
+        38690,
+        36251,
+        59915,
+        44758,
+        16298,
+        19358,
+        19550,
+        3141,
+        46873,
+        13045,
+        46866,
+        59435,
+        6177,
+        20001,
+        34836,
+        51459,
+        38816,
+        50902,
+        20144,
+        24139,
+        50207,
+        59670,
+        53276,
+        36835,
+        3952,
+        34810,
+        19760,
+        10930,
+        11249,
+        43376,
+        61666,
+        3222,
+        3323,
+        3323,
+        18666,
+        3311,
+        18671,
+        19695,
+        18603,
+        19694,
+        3311,
+        19690,
+        19690,
+        19690,
+        19690,
+        19690,
+        19690,
+        19690,
+        19690,
+        19690,
+        3306,
+        3306,
+        3306,
+        3306,
+        3306,
+        3306,
+        18666,
+        3306,
+        2278,
+        2298,
+        2474,
+        2086,
+        3302,
+        36311,
+        7260,
+        16362,
+        13373,
+        15036,
+        14185,
+        28442,
+        49195,
+        53274,
+        60950,
+        32748,
+        13199,
+        15244,
+        17935,
+        25761,
+        8229,
+        23446,
+        32483,
+        19175,
+        36855,
+        10699,
+        8626,
+        8378,
+        12339,
+        31991,
+        35751,
+        21098,
+        30247,
+        17826,
+        2657,
+        136,
+        13838,
+        9741,
+        38232,
+        46452,
+        313,
+        1462,
+        55971,
+        50199,
+        50883,
+        50968,
+        1433,
+        50964,
+        33721,
+        1653,
+        16822,
+        28419,
+        39987,
+        33840,
+        33617,
+        18181,
+        54664,
+        34126,
+        25673,
+        6814,
+        23786,
+        40807,
+        52709,
+        34730,
+        11421,
+        4623,
+        30797,
+        41165,
+        45461,
+        19281,
+        17063,
+        15027,
+        8582,
+        18016,
+        15752,
+        10865,
+        3657,
+        23089,
+        19586,
+        38647,
+        35798,
+        40723,
+        36659,
+        18488,
+        39811,
+        3956,
+        35310,
+        3169,
+        13665,
+        7129,
+        44375,
+        54543,
+        59789,
+        44040,
+        40906,
+        52012,
+        2333,
+        36524,
+        23416,
+        19121,
+        1259,
+        10919,
+        55523,
+        50602,
+        47334,
+        1162,
+        3319,
+        19627,
+        19691,
+        18603,
+        18603,
+        19694,
+        19694,
+        19690,
+        19690,
+        19690,
+        19690,
+        19690,
+        19690,
+        19606,
+        19622,
+        19622,
+        19622,
+        19622,
+        19622,
+        19686,
+        19690,
+        19690,
+        19686,
+        19686,
+        19670,
+        19674,
+        2265
+      ],
+      "text": "Không được phép gây sự Đợi sau khi họ rời đi Na Tra lúc này mới hỏi Sư phụ Có phải mình lại gây ra họa lớn rồi không.",
+      "description": "HH3D"
+    }
+  }
+}