Instructions to use f00d4tehg0dz/Yoda with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use f00d4tehg0dz/Yoda with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="f00d4tehg0dz/Yoda")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("f00d4tehg0dz/Yoda")
model = AutoModelForCausalLM.from_pretrained("f00d4tehg0dz/Yoda", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use f00d4tehg0dz/Yoda with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "f00d4tehg0dz/Yoda"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "f00d4tehg0dz/Yoda",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/f00d4tehg0dz/Yoda

SGLang

How to use f00d4tehg0dz/Yoda with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "f00d4tehg0dz/Yoda" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "f00d4tehg0dz/Yoda",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "f00d4tehg0dz/Yoda" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "f00d4tehg0dz/Yoda",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use f00d4tehg0dz/Yoda with Docker Model Runner:
```
docker model run hf.co/f00d4tehg0dz/Yoda
```

Yoda

Commit History

Adding `safetensors` variant of this model (#1)

524a57f
verified

f00d4tehg0dz

SFconvertbot commited on Jan 26, 2024

Create README.md

f7c3667

f00d4tehg0dz commited on Aug 30, 2021

add tokenizer

e123459

f00d4tehg0dz commited on Aug 30, 2021

add model

977dfbd

f00d4tehg0dz commited on Aug 30, 2021

initial commit

38c7ce9

system HF Staff commited on Aug 30, 2021

Commit History

Adding `safetensors` variant of this model (#1) 524a57f verified

Create README.md f7c3667

add tokenizer e123459

add model 977dfbd

initial commit 38c7ce9

Adding `safetensors` variant of this model (#1)

524a57f
verified

Create README.md

f7c3667

add tokenizer

e123459

add model

977dfbd

initial commit

38c7ce9