theprint/PositiveDetox
Viewer • Updated • 17.7k • 13
How to use theprint/PositiveDetox-Qwen3-4B with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-generation", model="theprint/PositiveDetox-Qwen3-4B")
messages = [
{"role": "user", "content": "Who are you?"},
]
pipe(messages) # Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("theprint/PositiveDetox-Qwen3-4B")
model = AutoModelForCausalLM.from_pretrained("theprint/PositiveDetox-Qwen3-4B")
messages = [
{"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
tokenize=True,
return_dict=True,
return_tensors="pt",
).to(model.device)
outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))How to use theprint/PositiveDetox-Qwen3-4B with vLLM:
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "theprint/PositiveDetox-Qwen3-4B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "theprint/PositiveDetox-Qwen3-4B",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'docker model run hf.co/theprint/PositiveDetox-Qwen3-4B
How to use theprint/PositiveDetox-Qwen3-4B with SGLang:
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
--model-path "theprint/PositiveDetox-Qwen3-4B" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "theprint/PositiveDetox-Qwen3-4B",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "theprint/PositiveDetox-Qwen3-4B" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "theprint/PositiveDetox-Qwen3-4B",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'How to use theprint/PositiveDetox-Qwen3-4B with Unsloth Studio:
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for theprint/PositiveDetox-Qwen3-4B to start chatting
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for theprint/PositiveDetox-Qwen3-4B to start chatting
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for theprint/PositiveDetox-Qwen3-4B to start chatting
pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
model_name="theprint/PositiveDetox-Qwen3-4B",
max_seq_length=2048,
)How to use theprint/PositiveDetox-Qwen3-4B with Docker Model Runner:
docker model run hf.co/theprint/PositiveDetox-Qwen3-4B
This model was finetuned on the Positive Detox data set, designed specifically to reduce or eliminate toxic positivity in AI responses.
This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.
If you are looking for a GGUF version of this model, if can be found at theprint/PositiveDetox-Qwen3-4B-GGUF.