Instructions to use pixelsandpointers/dialoGPT-small-empatheticdialogues-generation with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use pixelsandpointers/dialoGPT-small-empatheticdialogues-generation with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="pixelsandpointers/dialoGPT-small-empatheticdialogues-generation")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("pixelsandpointers/dialoGPT-small-empatheticdialogues-generation")
model = AutoModelForCausalLM.from_pretrained("pixelsandpointers/dialoGPT-small-empatheticdialogues-generation", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use pixelsandpointers/dialoGPT-small-empatheticdialogues-generation with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "pixelsandpointers/dialoGPT-small-empatheticdialogues-generation"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pixelsandpointers/dialoGPT-small-empatheticdialogues-generation",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/pixelsandpointers/dialoGPT-small-empatheticdialogues-generation

SGLang

How to use pixelsandpointers/dialoGPT-small-empatheticdialogues-generation with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "pixelsandpointers/dialoGPT-small-empatheticdialogues-generation" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pixelsandpointers/dialoGPT-small-empatheticdialogues-generation",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "pixelsandpointers/dialoGPT-small-empatheticdialogues-generation" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "pixelsandpointers/dialoGPT-small-empatheticdialogues-generation",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use pixelsandpointers/dialoGPT-small-empatheticdialogues-generation with Docker Model Runner:
```
docker model run hf.co/pixelsandpointers/dialoGPT-small-empatheticdialogues-generation
```

dialoGPT-small-empatheticdialogues-generation

Commit History

Adding `safetensors` variant of this model

95126ac

SFconvertbot commited on Mar 20, 2023

Update README.md

4a8d404

Benjamin Beilharz commited on Jan 27, 2022

Update README.md

242585e

Benjamin Beilharz commited on Jan 27, 2022

Update README.md

bf11c3b

Benjamin Beilharz commited on Jan 27, 2022

Update README.md

5895c6d

Benjamin Beilharz commited on Jan 27, 2022

Create README.md

64ef008

Benjamin Beilharz commited on Jan 27, 2022

add model

3715730

Benjamin Beilharz commited on Jan 25, 2022

add tokenizer

de2c472

Benjamin Beilharz commited on Jan 25, 2022

add model

30755a5

Benjamin Beilharz commited on Jan 25, 2022

Training in progress, step 4500

cd71f86

Benjamin Beilharz commited on Jan 24, 2022

Training in progress, step 4000

b8482e9

Benjamin Beilharz commited on Jan 24, 2022

Training in progress, step 3500

a0f5382

Benjamin Beilharz commited on Jan 24, 2022

Training in progress, step 3000

660b472

Benjamin Beilharz commited on Jan 24, 2022

Training in progress, step 2500

d67adac

Benjamin Beilharz commited on Jan 24, 2022

Training in progress, step 2000

03f9446

Benjamin Beilharz commited on Jan 24, 2022

Training in progress, step 1500

4515d5f

Benjamin Beilharz commited on Jan 24, 2022

Training in progress, step 1000

3537c31

Benjamin Beilharz commited on Jan 24, 2022