Instructions to use LLMWildling/gpt-oss-220a20b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use LLMWildling/gpt-oss-220a20b with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="LLMWildling/gpt-oss-220a20b")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("LLMWildling/gpt-oss-220a20b")
model = AutoModelForCausalLM.from_pretrained("LLMWildling/gpt-oss-220a20b", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use LLMWildling/gpt-oss-220a20b with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "LLMWildling/gpt-oss-220a20b"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "LLMWildling/gpt-oss-220a20b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/LLMWildling/gpt-oss-220a20b

SGLang

How to use LLMWildling/gpt-oss-220a20b with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "LLMWildling/gpt-oss-220a20b" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "LLMWildling/gpt-oss-220a20b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "LLMWildling/gpt-oss-220a20b" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "LLMWildling/gpt-oss-220a20b",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use LLMWildling/gpt-oss-220a20b with Docker Model Runner:
```
docker model run hf.co/LLMWildling/gpt-oss-220a20b
```

LLMWildling commited on May 7

Commit

e2aa41c

verified ·

1 Parent(s): 8daf804

Add files using upload-large-folder tool

Browse files

Files changed (30) hide show

model-00003.safetensors +3 -0
model-00004.safetensors +3 -0
model-00005.safetensors +3 -0
model-00007.safetensors +3 -0
model-00014.safetensors +3 -0
model-00016.safetensors +3 -0
model-00017.safetensors +3 -0
model-00020.safetensors +3 -0
model-00021.safetensors +3 -0
model-00022.safetensors +3 -0
model-00024.safetensors +3 -0
model-00026.safetensors +3 -0
model-00027.safetensors +3 -0
model-00028.safetensors +3 -0
model-00029.safetensors +3 -0
model-00032.safetensors +3 -0
model-00034.safetensors +3 -0
model-00036.safetensors +3 -0
model-00038.safetensors +3 -0
model-00040.safetensors +3 -0
model-00048.safetensors +3 -0
model-00050.safetensors +3 -0
model-00052.safetensors +3 -0
model-00059.safetensors +3 -0
model-00060.safetensors +3 -0
model-00063.safetensors +3 -0
model-00068.safetensors +3 -0
model-00069.safetensors +3 -0
model-00071.safetensors +3 -0
model-00073.safetensors +3 -0

model-00003.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:20bd707c5b6f1a0f26ad920974cb0f9787e31bee5b5919c09c73cd51c0eae2cc
+size 1155900752

model-00004.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:51613d6de22684824230c6c696118f67ee1b049dfc250e3bd0f4b36c96579d9d
+size 2185574656

model-00005.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:144ec29f68c96f576526fc45d54d8d188263d13b44d6d7ff510d42263935564a
+size 1155900752

model-00007.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6fa6a81f1ddbbc60030246a46b9d3772b04f20f9a07606bdb65b18ca457e591a
+size 1155900752

model-00014.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:254c4bbb1076c6429b7f45dbdfce32fe5b7282c9b868e9452b2cf55511176fc7
+size 2185574656

model-00016.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:05087e2b4c7b7ce76ce9cb24cd9e17681e88a1bfada41a6eac1d9c524fada902
+size 2185574656

model-00017.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:840b412495d123497980089affcf2385591cd333bf2d569f5993055d286c9552
+size 1155900752

model-00020.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2bfa8d9bff575ed48ddee3f0737824a1cb6287e4c76196bb5d7e83cd643daf3b
+size 2185574656

model-00021.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:07a63e966413ba29c01666c845620d9cbb4acb4a3e38953f47e1511f70d15d73
+size 1155900760

model-00022.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3dd2fb20e4ad8abbcb51861d53275b625b9dea2edad4fa8205bcde8a5e635604
+size 2185574656

model-00024.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7b2492f3486d70352c80962cad6b9bfb3f61ffaa6187598907c8754684afcb23
+size 2185574656

model-00026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:22c50697545c7e729552bcdcfc4c48d7f0e6cfdedfe654ae8775ebebbf0328dc
+size 2185574656

model-00027.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:79fc2e7e77805d24f0ab2443c34fa356255dfde48c3f2e239c7f9caf158cb916
+size 1155900768

model-00028.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fd631c24b4aa7d1af408fc144890785c9229a852c36a21298537e8ec3480c6a2
+size 2185574656

model-00029.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:375dc8e3ae896f2148870a00bdeef7c18b70bf2ca04eddcd0d1903d10949af55
+size 1155900768

model-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2c0f062b3860ca7096c4a9f329d5310fb377333eff04f3ee9b8c0035d719202f
+size 2185574656

model-00034.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4ac5c20eebb38ef0296219d86e0ff12c63f8ba7418188d4c4ba9ffee0304394a
+size 2185574656

model-00036.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8495d2dd0f8b3ae13bea664a3897196f6dc56959f7ac51dcdd2649cae1165514
+size 2185574656

model-00038.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:97f3cce5224544932c4e0ae3787ba7ce5a6a1a026c2d005bb86ded5e6854eef9
+size 2185574656

model-00040.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:95514f60f529bd386292e1fb4261b3f1bc83e23f609d3c303af9cab4a175e93f
+size 2185574656

model-00048.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cdfc500935725af59365160de980cddd60693e58a5025a200344f58fe9cea305
+size 2185574656

model-00050.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b867d14d01c650ab28d3cf1d00f7dabac0d7abdd22a51425ccec3af977351712
+size 2185574656

model-00052.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:70591aff79d37d388518ef0f552be350fffffe6a3f2d5c7bc594a90f8347de02
+size 2185574656

model-00059.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:63131f892004e2a1fa19929e986cd3a14471c14898f64575f654195bf22fa018
+size 1155900768

model-00060.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9359c869b868f57ebfbc2855a31442c33ff449cf042ef583b7d751a72b96bb66
+size 2185574656

model-00063.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:be6064df78e096225848d083119e8f093c3307638e74653798a8e59495dcceb8
+size 1155900768

model-00068.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:de049e8ddb5908a35edaf5ac37e8c46c319b9790be8a59214d6b165a1b83784a
+size 2185574656

model-00069.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3c23ca428bbfbe221c4d021585d10febd6c1486460d232a42e48cea6b1dc457
+size 1155900768

model-00071.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5e54f2e51f837d3b07d452c49ace0a089997bec0eb6b4243ee00562040d5cb47
+size 1155900768

model-00073.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7e83c466bc97c419e01d63c95793192d473e218b0a9680d0bad39830049f9024
+size 1102787760