Instructions to use cs-552-2026-MandMP/math_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use cs-552-2026-MandMP/math_model with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="cs-552-2026-MandMP/math_model")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("cs-552-2026-MandMP/math_model")
model = AutoModelForCausalLM.from_pretrained("cs-552-2026-MandMP/math_model", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use cs-552-2026-MandMP/math_model with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "cs-552-2026-MandMP/math_model"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-MandMP/math_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/cs-552-2026-MandMP/math_model

SGLang

How to use cs-552-2026-MandMP/math_model with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "cs-552-2026-MandMP/math_model" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-MandMP/math_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "cs-552-2026-MandMP/math_model" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "cs-552-2026-MandMP/math_model",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use cs-552-2026-MandMP/math_model with Docker Model Runner:
```
docker model run hf.co/cs-552-2026-MandMP/math_model
```

math_model

Commit History

Automated MNLP evaluation report (2026-05-19)

9330090
verified

zechen-nlp commited on May 19

Fix generation_config: correct pad_token_id, add bos_token_id, remove training-time overrides

3a4ce59
verified

sohaddad commited on May 18

Automated MNLP evaluation report (2026-05-18) (#2)

63c4966

sohaddad

zechen-nlp commited on May 18

Remove training_args.bin (training artifact, not needed for inference)

b455b43
verified

sohaddad commited on May 17

Remove trainer_state.json (training artifact, not needed for inference)

eccf3f4
verified

sohaddad commited on May 17

Remove scheduler.pt (training artifact, not needed for inference)

0b52c5b
verified

sohaddad commited on May 17

Remove rng_state.pth (training artifact, not needed for inference)

9584bd0
verified

sohaddad commited on May 17

Remove optimizer.pt (training artifact, not needed for inference)

0776556
verified

sohaddad commited on May 17

Distilled checkpoint (Qwen3-8B teacher, MATH train, 2 epochs)

6f45883
verified

sohaddad commited on May 17

Automated MNLP evaluation report (2026-05-13) (#1)

b90a696

sohaddad

zechen-nlp commited on May 13

Add thinking_token_budget=1500 to generation config

bec4dc9
verified

sohaddad commited on May 12

Fix system prompt with correct boxed format

650e0ad
verified

sohaddad commited on May 12

Add default system prompt for boxed format compliance

c79a414
verified

sohaddad commited on May 12

Remove training_args.bin artifact

d04b411
verified

sohaddad commited on May 12

Restore max_new_tokens in generation_config

fdeb43f
verified

sohaddad commited on May 12

Remove training artifacts and checkpoint folders

5299acc
verified

sohaddad commited on May 12

Upload folder using huggingface_hub

bf7cb5b
verified

sohaddad commited on May 12

Upload tokenizer

a141847
verified

sohaddad commited on May 12

Upload Qwen3ForCausalLM

609e9b1
verified

sohaddad commited on May 12

initial commit

56002cc
verified

sohaddad commited on May 12

Commit History

Automated MNLP evaluation report (2026-05-19) 9330090 verified

Fix generation_config: correct pad_token_id, add bos_token_id, remove training-time overrides 3a4ce59 verified

Automated MNLP evaluation report (2026-05-18) (#2) 63c4966

Remove training_args.bin (training artifact, not needed for inference) b455b43 verified

Remove trainer_state.json (training artifact, not needed for inference) eccf3f4 verified

Remove scheduler.pt (training artifact, not needed for inference) 0b52c5b verified

Remove rng_state.pth (training artifact, not needed for inference) 9584bd0 verified

Remove optimizer.pt (training artifact, not needed for inference) 0776556 verified

Distilled checkpoint (Qwen3-8B teacher, MATH train, 2 epochs) 6f45883 verified

Automated MNLP evaluation report (2026-05-13) (#1) b90a696

Add thinking_token_budget=1500 to generation config bec4dc9 verified

Fix system prompt with correct boxed format 650e0ad verified

Add default system prompt for boxed format compliance c79a414 verified

Remove training_args.bin artifact d04b411 verified

Restore max_new_tokens in generation_config fdeb43f verified

Remove training artifacts and checkpoint folders 5299acc verified

Upload folder using huggingface_hub bf7cb5b verified

Upload tokenizer a141847 verified

Upload Qwen3ForCausalLM 609e9b1 verified

initial commit 56002cc verified

Automated MNLP evaluation report (2026-05-19)

9330090
verified

Fix generation_config: correct pad_token_id, add bos_token_id, remove training-time overrides

3a4ce59
verified

Automated MNLP evaluation report (2026-05-18) (#2)

63c4966

Remove training_args.bin (training artifact, not needed for inference)

b455b43
verified

Remove trainer_state.json (training artifact, not needed for inference)

eccf3f4
verified

Remove scheduler.pt (training artifact, not needed for inference)

0b52c5b
verified

Remove rng_state.pth (training artifact, not needed for inference)

9584bd0
verified

Remove optimizer.pt (training artifact, not needed for inference)

0776556
verified

Distilled checkpoint (Qwen3-8B teacher, MATH train, 2 epochs)

6f45883
verified

Automated MNLP evaluation report (2026-05-13) (#1)

b90a696

Add thinking_token_budget=1500 to generation config

bec4dc9
verified

Fix system prompt with correct boxed format

650e0ad
verified

Add default system prompt for boxed format compliance

c79a414
verified

Remove training_args.bin artifact

d04b411
verified

Restore max_new_tokens in generation_config

fdeb43f
verified

Remove training artifacts and checkpoint folders

5299acc
verified

Upload folder using huggingface_hub

bf7cb5b
verified

Upload tokenizer

a141847
verified

Upload Qwen3ForCausalLM

609e9b1
verified

initial commit

56002cc
verified