Instructions to use cutycat2000/MeowGPT-2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use cutycat2000/MeowGPT-2 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="cutycat2000/MeowGPT-2")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("cutycat2000/MeowGPT-2")
model = AutoModelForCausalLM.from_pretrained("cutycat2000/MeowGPT-2")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use cutycat2000/MeowGPT-2 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "cutycat2000/MeowGPT-2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cutycat2000/MeowGPT-2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/cutycat2000/MeowGPT-2

SGLang

How to use cutycat2000/MeowGPT-2 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "cutycat2000/MeowGPT-2" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cutycat2000/MeowGPT-2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "cutycat2000/MeowGPT-2" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cutycat2000/MeowGPT-2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use cutycat2000/MeowGPT-2 with Docker Model Runner:
```
docker model run hf.co/cutycat2000/MeowGPT-2
```

MeowGPT-2

Commit History

Update README.md

325bd77

cutycat2000 commited on Dec 22, 2023

Upload tokenizer.model

e9517fa

cutycat2000 commited on Dec 22, 2023

Update config.json

68b2346

cutycat2000 commited on Dec 22, 2023

Update README.md

9613892

cutycat2000 commited on Dec 22, 2023

Upload 2 files

33c2c8c

cutycat2000 commited on Dec 22, 2023

Update config.json

dbf82e5

cutycat2000 commited on Dec 22, 2023

Upload 3 files

7b0f1f0

cutycat2000 commited on Dec 22, 2023

Update README.md

7550590

cutycat2000 commited on Dec 22, 2023

Update README.md

6d09140

cutycat2000 commited on Dec 22, 2023

Delete conversation.py

71eebb5

cutycat2000 commited on Dec 22, 2023

Update README.md

d19747c

cutycat2000 commited on Dec 22, 2023

Update README.md

0cde58e

cutycat2000 commited on Dec 22, 2023

Update README.md

78c772d

cutycat2000 commited on Dec 22, 2023

Upload conversation.py

c52bff7

cutycat2000 commited on Dec 22, 2023

Update README.md

2bbdd4d

cutycat2000 commited on Dec 22, 2023

Rename README (3).md to README.md

66e4565

FreeAI commited on Dec 22, 2023

Upload README (3).md

88f0693

FreeAI commited on Dec 22, 2023

initial commit

a7fdc10

cutycat2000 commited on Dec 22, 2023

Commit History

Update README.md 325bd77

Upload tokenizer.model e9517fa

Update config.json 68b2346

Update README.md 9613892

Upload 2 files 33c2c8c

Update config.json dbf82e5

Upload 3 files 7b0f1f0

Update README.md 7550590

Update README.md 6d09140

Delete conversation.py 71eebb5

Update README.md d19747c

Update README.md 0cde58e

Update README.md 78c772d

Upload conversation.py c52bff7

Update README.md 2bbdd4d

Rename README (3).md to README.md 66e4565

Upload README (3).md 88f0693

initial commit a7fdc10

Update README.md

325bd77

Upload tokenizer.model

e9517fa

Update config.json

68b2346

Update README.md

9613892

Upload 2 files

33c2c8c

Update config.json

dbf82e5

Upload 3 files

7b0f1f0

Update README.md

7550590

Update README.md

6d09140

Delete conversation.py

71eebb5

Update README.md

d19747c

Update README.md

0cde58e

Update README.md

78c772d

Upload conversation.py

c52bff7

Update README.md

2bbdd4d

Rename README (3).md to README.md

66e4565

Upload README (3).md

88f0693

initial commit

a7fdc10