Instructions to use hivetrace/HiveTraceGuard-Pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use hivetrace/HiveTraceGuard-Pro with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="hivetrace/HiveTraceGuard-Pro")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("hivetrace/HiveTraceGuard-Pro")
model = AutoModelForCausalLM.from_pretrained("hivetrace/HiveTraceGuard-Pro", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use hivetrace/HiveTraceGuard-Pro with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "hivetrace/HiveTraceGuard-Pro"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "hivetrace/HiveTraceGuard-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/hivetrace/HiveTraceGuard-Pro

SGLang

How to use hivetrace/HiveTraceGuard-Pro with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "hivetrace/HiveTraceGuard-Pro" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "hivetrace/HiveTraceGuard-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "hivetrace/HiveTraceGuard-Pro" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "hivetrace/HiveTraceGuard-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use hivetrace/HiveTraceGuard-Pro with Docker Model Runner:
```
docker model run hf.co/hivetrace/HiveTraceGuard-Pro
```

HiveTraceGuard-Pro

Commit History

Update README.md

ed00827
verified

nikiduki commited on 1 day ago

Update README.md

457ee18
verified

nikiduki commited on 16 days ago

Update README.md

be379f3
verified

nikiduki commited on 16 days ago

Update README.md

9ea0a0b
verified

nikiduki commited on 16 days ago

Update README.md

77eeccf
verified

nikiduki commited on 16 days ago

Update generation_config.json

a842d66
verified

nikiduki commited on 25 days ago

README: Evaluation section (drop guardbench naming)

28de234
verified

nikiduki commited on Jul 28

readme: leaderboard-only benchmark table

2209697
verified

nikiduki commited on Jul 28

Release 1.1.0: champion Qwen3-0.6B guard weights; greedy generation_config; guardbench model card

4ddacfe

hivetrace commited on Jul 28

Add generation_config.json for vLLM defaults (max_new_tokens=1)

cb23643
verified

nikiduki commited on May 21

Update model card README

ec67b6f
verified

nikiduki commited on May 21

Publish HiveTraceGuard-Pro as copy of HiveTracePro

554ac91
verified

nikiduki commited on May 21

initial commit

78f072e
verified

nikiduki commited on May 21

Commit History

Update README.md ed00827 verified

Update README.md 457ee18 verified

Update README.md be379f3 verified

Update README.md 9ea0a0b verified

Update README.md 77eeccf verified

Update generation_config.json a842d66 verified

README: Evaluation section (drop guardbench naming) 28de234 verified

readme: leaderboard-only benchmark table 2209697 verified

Release 1.1.0: champion Qwen3-0.6B guard weights; greedy generation_config; guardbench model card 4ddacfe

Add generation_config.json for vLLM defaults (max_new_tokens=1) cb23643 verified

Update model card README ec67b6f verified

Publish HiveTraceGuard-Pro as copy of HiveTracePro 554ac91 verified

initial commit 78f072e verified

Update README.md

ed00827
verified

Update README.md

457ee18
verified

Update README.md

be379f3
verified

Update README.md

9ea0a0b
verified

Update README.md

77eeccf
verified

Update generation_config.json

a842d66
verified

README: Evaluation section (drop guardbench naming)

28de234
verified

readme: leaderboard-only benchmark table

2209697
verified

Release 1.1.0: champion Qwen3-0.6B guard weights; greedy generation_config; guardbench model card

4ddacfe

Add generation_config.json for vLLM defaults (max_new_tokens=1)

cb23643
verified

Update model card README

ec67b6f
verified

Publish HiveTraceGuard-Pro as copy of HiveTracePro

554ac91
verified

initial commit

78f072e
verified