Instructions to use Emperorizzis/ASTRA-32B-Thinking-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Emperorizzis/ASTRA-32B-Thinking-v1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Emperorizzis/ASTRA-32B-Thinking-v1")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Emperorizzis/ASTRA-32B-Thinking-v1")
model = AutoModelForCausalLM.from_pretrained("Emperorizzis/ASTRA-32B-Thinking-v1", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Emperorizzis/ASTRA-32B-Thinking-v1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Emperorizzis/ASTRA-32B-Thinking-v1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Emperorizzis/ASTRA-32B-Thinking-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Emperorizzis/ASTRA-32B-Thinking-v1

SGLang

How to use Emperorizzis/ASTRA-32B-Thinking-v1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Emperorizzis/ASTRA-32B-Thinking-v1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Emperorizzis/ASTRA-32B-Thinking-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Emperorizzis/ASTRA-32B-Thinking-v1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Emperorizzis/ASTRA-32B-Thinking-v1",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Emperorizzis/ASTRA-32B-Thinking-v1 with Docker Model Runner:
```
docker model run hf.co/Emperorizzis/ASTRA-32B-Thinking-v1
```

ASTRA-32B-Thinking-v1

Commit History

Add library_name and pipeline_tag metadata (#1)

7059528

Emperorizzis

nielsr HF Staff commited on Feb 2

Update README.md

1842bf8
verified

Emperorizzis commited on Jan 30

Update README.md

f4fc5ea
verified

Emperorizzis commited on Jan 30

Update README.md

b5e6ef5
verified

Emperorizzis commited on Jan 23

Update README.md

681ee8d
verified

Emperorizzis commited on Jan 21

Update README.md

5fcdac9
verified

Emperorizzis commited on Jan 21

Upload model_performance.png

72deaf4
verified

Emperorizzis commited on Jan 21

upload model

e3ff6e3
verified

Emperorizzis commited on Jan 21

initial commit

0a50f13
verified

Emperorizzis commited on Jan 21

Commit History

Add library_name and pipeline_tag metadata (#1) 7059528

Update README.md 1842bf8 verified

Update README.md f4fc5ea verified

Update README.md b5e6ef5 verified

Update README.md 681ee8d verified

Update README.md 5fcdac9 verified

Upload model_performance.png 72deaf4 verified

upload model e3ff6e3 verified

initial commit 0a50f13 verified

Add library_name and pipeline_tag metadata (#1)

7059528

Update README.md

1842bf8
verified

Update README.md

f4fc5ea
verified

Update README.md

b5e6ef5
verified

Update README.md

681ee8d
verified

Update README.md

5fcdac9
verified

Upload model_performance.png

72deaf4
verified

upload model

e3ff6e3
verified

initial commit

0a50f13
verified