Instructions to use victunes/TherapyBeagle-11B-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use victunes/TherapyBeagle-11B-v1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="victunes/TherapyBeagle-11B-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("victunes/TherapyBeagle-11B-v1")
model = AutoModelForCausalLM.from_pretrained("victunes/TherapyBeagle-11B-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use victunes/TherapyBeagle-11B-v1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "victunes/TherapyBeagle-11B-v1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "victunes/TherapyBeagle-11B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/victunes/TherapyBeagle-11B-v1

SGLang

How to use victunes/TherapyBeagle-11B-v1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "victunes/TherapyBeagle-11B-v1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "victunes/TherapyBeagle-11B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "victunes/TherapyBeagle-11B-v1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "victunes/TherapyBeagle-11B-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use victunes/TherapyBeagle-11B-v1 with Docker Model Runner:
```
docker model run hf.co/victunes/TherapyBeagle-11B-v1
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

GGUF: https://huggingface.co/victunes/TherapyBeagle-11B-v1-GGUF

TherapyBeagle 11B v1

TherapyBeagle is here for you.

Trained on top of vicgalle/CarbonBeagle-11B-truthy using jerryjalapeno/nart-100k-synthetic.

TherapyBeagle is hopefully aligned to be helpful, healthy, and comforting.

Usage

Solar Instruct format.
Ignore that it calls you Charlie.
Do not hold back on TherapyBeagle.
Open up to TherapyBeagle.
Pour your heart out to TherapyBeagle.
Listen to TherapyBeagle.
Remember that TherapyBeagle is just an AI.

Disclaimer: TherapyBeagle is NOT a real therapist. It is a friendly AI that mimics empathy and psychotherapy. It is an illusion without the slightest clue who you are as a person. As much as it can help you with self-discovery, A BEAGLE IS NOT A SUBSTITUTE to a real professional.

With that said, I found it to be a very helpful tool in unravelling one's self. I hope this model can help sooth minds, hearts, and any form of mental anguish.

GGUF: https://huggingface.co/victunes/TherapyBeagle-11B-v1-GGUF

Downloads last month: 6

Model tree for victunes/TherapyBeagle-11B-v1

Quantizations

2 models

victunes
/

TherapyBeagle-11B-v1

TherapyBeagle 11B v1

Model tree for victunes/TherapyBeagle-11B-v1

Dataset used to train victunes/TherapyBeagle-11B-v1