Instructions to use HectorHe/gpt-oss-20b-math7k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use HectorHe/gpt-oss-20b-math7k with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="HectorHe/gpt-oss-20b-math7k")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("HectorHe/gpt-oss-20b-math7k")
model = AutoModelForCausalLM.from_pretrained("HectorHe/gpt-oss-20b-math7k", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use HectorHe/gpt-oss-20b-math7k with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "HectorHe/gpt-oss-20b-math7k"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HectorHe/gpt-oss-20b-math7k",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/HectorHe/gpt-oss-20b-math7k

SGLang

How to use HectorHe/gpt-oss-20b-math7k with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "HectorHe/gpt-oss-20b-math7k" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HectorHe/gpt-oss-20b-math7k",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "HectorHe/gpt-oss-20b-math7k" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HectorHe/gpt-oss-20b-math7k",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use HectorHe/gpt-oss-20b-math7k with Docker Model Runner:
```
docker model run hf.co/HectorHe/gpt-oss-20b-math7k
```

HectorHe commited on Aug 14, 2025

Commit

d737bcf

verified ·

1 Parent(s): ab750f2

Training in progress, step 645

Browse files

Files changed (9) hide show

model-00001-of-00009.safetensors +1 -1
model-00002-of-00009.safetensors +1 -1
model-00003-of-00009.safetensors +1 -1
model-00004-of-00009.safetensors +1 -1
model-00005-of-00009.safetensors +1 -1
model-00006-of-00009.safetensors +1 -1
model-00007-of-00009.safetensors +1 -1
model-00008-of-00009.safetensors +1 -1
model-00009-of-00009.safetensors +1 -1

model-00001-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:086916f63bc39552eceb692198fcb47a5af04df9968276ac76413cabbc84b0db
 size 4504304664

 version https://git-lfs.github.com/spec/v1
+oid sha256:21bef425b14b930234c8643aa98617ac3354fee5a9fb905dd2e1f5297f362be2
 size 4504304664

model-00002-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f9406d4cf7f4eb6e4300e4b5bcf28a791b511db9aad348d38914b4d6ca7c26fa
 size 4939127656

 version https://git-lfs.github.com/spec/v1
+oid sha256:3f9cfe107a0143511c92715efd46233853b5217d6ad5b37f4b2342c2d2582a19
 size 4939127656

model-00003-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:128369c2bb1d543fbf47f53c6104bd6775c1e8a65f6fcdcf196eadee58704fe4
 size 4939127656

 version https://git-lfs.github.com/spec/v1
+oid sha256:f1d5689fcab52f1ab596e37c4f4ef659aec33fc6cbcceb08928c2592ad2ede76
 size 4939127656

model-00004-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:03b30c2186f057cf525086667b3f277cc8a581764c1c9a2941cb590413e5536c
 size 4939127680

 version https://git-lfs.github.com/spec/v1
+oid sha256:087f605ed21361c761f5505a69f0a8539be7318ab592b656188d9e0d8a42def8
 size 4939127680

model-00005-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1bb049e452233d68f6454a838e435942e36f073adc7061018fe83d25358f3257
 size 4939127704

 version https://git-lfs.github.com/spec/v1
+oid sha256:62b2ff0b1351eca5fbbf4fcf9119231e55f116b55ef0d705637e2db385fdeebd
 size 4939127704

model-00006-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c2016c7816d909aa40cfb589f31bb5ccb944459bed7dfbb6c4109f730ef6806f
 size 4939127704

 version https://git-lfs.github.com/spec/v1
+oid sha256:409c04c79637124481139f15e45d16c6affdf125fc089b0a147b4feeb73c729c
 size 4939127704

model-00007-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2300e633b72681bdb1d90eea3165f8e6389b5bfe0db01cf6982fb14263230b5f
 size 4939127704

 version https://git-lfs.github.com/spec/v1
+oid sha256:eb025fffb2095b81db3c586b5cf1640cbd1433eae0b0b8c0b43edfac8e8ddcf9
 size 4939127704

model-00008-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:22942bfe74517b59726557eaa660903dcfe9c6ac2d613aeda91ffb45b5b5f57b
 size 4939127704

 version https://git-lfs.github.com/spec/v1
+oid sha256:98ccad8e471e4c9710742c4f072e14a55377171bae5354416ff389f6d1b6962a
 size 4939127704

model-00009-of-00009.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3dea95041d866baba7b9032c941576de81d9e5e098b14307a1b9ba4eb45373f2
 size 2751362856

 version https://git-lfs.github.com/spec/v1
+oid sha256:830c457450058f8d2658891cde51965214f4d80f0fd9b3b562a5ab473e024910
 size 2751362856