Instructions to use cvnberk/DialoGPT-small-crd3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use cvnberk/DialoGPT-small-crd3 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="cvnberk/DialoGPT-small-crd3")

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("cvnberk/DialoGPT-small-crd3")
model = AutoModelForMultimodalLM.from_pretrained("cvnberk/DialoGPT-small-crd3")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use cvnberk/DialoGPT-small-crd3 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "cvnberk/DialoGPT-small-crd3"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cvnberk/DialoGPT-small-crd3",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/cvnberk/DialoGPT-small-crd3

SGLang

How to use cvnberk/DialoGPT-small-crd3 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "cvnberk/DialoGPT-small-crd3" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cvnberk/DialoGPT-small-crd3",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "cvnberk/DialoGPT-small-crd3" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cvnberk/DialoGPT-small-crd3",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use cvnberk/DialoGPT-small-crd3 with Docker Model Runner:
```
docker model run hf.co/cvnberk/DialoGPT-small-crd3
```

DialoGPT-small-crd3

Commit History

End of training

5641bcc

CK commited on Sep 14, 2023

Training in progress, step 8500

9df31ca

CK commited on Sep 14, 2023

Training in progress, step 8000

55ef648

CK commited on Sep 14, 2023

Training in progress, step 7500

63bc46b

CK commited on Sep 14, 2023

Training in progress, step 7000

c04b2d4

CK commited on Sep 14, 2023

Training in progress, step 6500

02f9ce3

CK commited on Sep 14, 2023

Training in progress, step 6000

1f548a8

CK commited on Sep 14, 2023

Training in progress, step 5500

e4f3969

CK commited on Sep 14, 2023

Training in progress, step 5000

bdb3ead

CK commited on Sep 14, 2023

Training in progress, step 4500

924e223

CK commited on Sep 14, 2023

Training in progress, step 4000

80829c2

CK commited on Sep 14, 2023

Training in progress, step 3500

9081506

CK commited on Sep 14, 2023

Training in progress, step 3000

511ca9b

CK commited on Sep 14, 2023

Training in progress, step 2500

4802ec1

CK commited on Sep 14, 2023

Training in progress, step 2000

0ccc91a

CK commited on Sep 14, 2023

Training in progress, step 1500

9e47431

CK commited on Sep 14, 2023

Training in progress, step 1000

1447a4e

CK commited on Sep 14, 2023

Training in progress, step 500

ef93507

CK commited on Sep 14, 2023

initial commit

85dc387

cvnberk commited on Sep 14, 2023

Commit History

End of training 5641bcc

Training in progress, step 8500 9df31ca

Training in progress, step 8000 55ef648

Training in progress, step 7500 63bc46b

Training in progress, step 7000 c04b2d4

Training in progress, step 6500 02f9ce3

Training in progress, step 6000 1f548a8

Training in progress, step 5500 e4f3969

Training in progress, step 5000 bdb3ead

Training in progress, step 4500 924e223

Training in progress, step 4000 80829c2

Training in progress, step 3500 9081506

Training in progress, step 3000 511ca9b

Training in progress, step 2500 4802ec1

Training in progress, step 2000 0ccc91a

Training in progress, step 1500 9e47431

Training in progress, step 1000 1447a4e

Training in progress, step 500 ef93507

initial commit 85dc387

End of training

5641bcc

Training in progress, step 8500

9df31ca

Training in progress, step 8000

55ef648

Training in progress, step 7500

63bc46b

Training in progress, step 7000

c04b2d4

Training in progress, step 6500

02f9ce3

Training in progress, step 6000

1f548a8

Training in progress, step 5500

e4f3969

Training in progress, step 5000

bdb3ead

Training in progress, step 4500

924e223

Training in progress, step 4000

80829c2

Training in progress, step 3500

9081506

Training in progress, step 3000

511ca9b

Training in progress, step 2500

4802ec1

Training in progress, step 2000

0ccc91a

Training in progress, step 1500

9e47431

Training in progress, step 1000

1447a4e

Training in progress, step 500

ef93507

initial commit

85dc387